advertools package

Subpackages

• advertools.cli module
• advertools.code_recipes package
  • Submodules
    • 🕷 SEO Crawling & Scraping: Strategies & Recipes
      • How to crawl a list of pages, and those pages only (list mode)?
      • How can I crawl a website including its sub-domains?
      • How can I save a copy of the logs of my crawl for auditing them later?
      • How can I automatically stop my crawl based on a certain condition?
      • How can I (dis)obey robots.txt rules?
      • How do I set my User-agent while crawling?
      • How can I control the number of concurrent requests while crawling?
      • How can I slow down the crawling so I don't hit the websites' servers too hard?
      • How can I set multiple settings to the same crawl job?
      • I want to crawl a list of pages, follow links from those pages, but only to a certain specified depth
      • How do I pause/resume crawling, while making sure I don't crawl the same page twice?
      • How do I use a proxy while crawling?
      • How can I change the default request headers?
      • XPath expressions for custom extraction
  • Module contents

Submodules

• Create Ads on a Large Scale
• Create Ads Using Long Descriptive Text (top-down approach)
  • Google Text Ads
  • Facebook Feed Ads
  • Facebook Instant Article Ad
• advertools.cli module
• Crawling and Scraping Analysis
  • Analyzing crawled images
  • Analyzing links in a crawled website
  • Analyzing the redirects of a crawled website
  • Handling very large crawl files
  • Compressing large crawl files
  • Exploring the columns and data types of parquet files
  • Module functions
• Emoji: Extract, Analyze, and Get Insights
  • Emoji Search
  • Extract Emoji from Text
• Extract structured entities from text lists
  • Extract Functions
  • Extract #hashtags
  • Extract @mentions
  • Extract Currency $ ¢ £ ¤ ¥ ֏ ؋ ₲ ₵ ₸ ₹﹩ ￠ ￡ ￥ ￦ ₺ ₻ ₼ ₽ ₾ ₿ ﷼
  • Extract numbers 1234567890٠١٢٣٤٥٦٧٨٩㊺𑁛𐄍𐢪⓲𑁣𐄨𐤛
  • Extract questions ? ¿ ; ՞ ؟ ፧ ᥅ ⁇ ⁈ ⁉ ⳺ ⳻ ⸮ ꘏ ꛷ ︖ ﹖ ？ 𑅃 𞥟 ʔ ‽
  • Extract Exclamations ! ¡ ՜ ߹ ᥄ ‼ ⁈ ⁉ ︕ ﹗ ！ 𞥞
  • Extract Emoji 😂😭🥺🤣❤️✨🙏😍
• 🕷 Python Status Code Checker with Response Headers
• Image Crawler and Downloader
  • Image file names
• Import and Analyze Knowledge Graph Results on a Large Scale
  • Account Setup
  • How to use Google's Knowledge Graph API
• Generate Keywords for SEM Campaigns
• Log File Analysis
  • How to run the logs_to_df() function:
  • Supported Log Formats
  • Log File Analysis - Data Preparation
• Parse and Analyze Crawl Logs in a Dataframe
• Regular Expressions for Extracting Structured Entities
• Reverse DNS Lookup in Bulk
• 🤖 Analyze and Test robots.txt Files on a Large Scale
  • Bulk robots.txt Tester
  • User-agents
  • robots.txt Testing Approach
• Import Search Engine Results Pages (SERPs) for Google and YouTube
• Download, Parse, and Analyze XML Sitemaps
  • Sitemap Index
  • Regular XML Sitemaps
  • News Sitemaps
  • Video Sitemaps
• 🕷 Python SEO Crawler / Spider
  • Discovery Crawling Approach
  • Extracted On-Page SEO Elements
  • Pre-Determined Crawling Approach (List Mode)
    • SERP Data
    • News Articles
    • Google Analytics / Google Search Console
  • Custom Extraction with CSS and XPath Selectors
  • Customizing the Crawling Behavior while Following Links
    • URL Query Parameters
    • URL Regex Patterns
  • Spider Custom Settings and Additional Functionality
• Stopwords in Several Languages
  • Stopword Languages
• Twitter Data API
  • Authentication
  • Functions
• URL Builders
• Split, Parse, and Analyze URL Structure
  • Query Parameters
  • The URL Path (Directories):
  • Analyzing a large number of URLs
• Text Analysis
  • Absolute and Weighted Word Count
    • Absolute vs Weighted Frequency
• Tokenize Words (N-grams)
• YouTube Data API

Module contents

Digital Marketing productivity and analysis tools.