The scraping and extracting of public data is protected by the First Amendment of the United States Constitution. The Ninth Circuit Court of Appeals ruled that automated scraping of publicly accessible data does not violate the Computer Fraud and Abuse Act (CFAA). Although, You should seek the counsel of an attorney on your specific matter to comply with the laws in your jurisdiction.
Payments & Subscriptions
When you start a task and you don’t have an active subscription the new subscription will be created.
You can stop the subscription any time on the profile page or it will be finished automatically in one month.
When a subscription will be finalized you will receive an invoice for the usage of the services during the subscription period.
In case you’re not able to make a payment within 3 days the system will try to charge you automatically.
Google Maps Scraper
Sometimes Google adds other categories to your searches. For example, when you search for restaurants you might see bars, coffee shops, etc.
Outscraper provides you with two tools that you can use to eliminate those categories.
- Use “Quote categories” checkbox. The categories will be enclosed between quotation marks ” “. The ” “ operator is typically used when you want Google to return only those companies that match your category terms exactly.
- Filter results by applying filters to the extraction task. To avoid empty results, make sure you are familiar with the values of the fields before using filters with the “contains” operator.
There are some cases when predefined locations or/and categories aren’t enough. Use “Custom locations” or/and “Custom categories” options to insert the categories or/and locations you need.
There is a limitation from Google Maps that shows only up to 400-500 places per one query search. This may be a problem when there are more companies in one category. For example, for query “restaurants, Brooklyn”.
Or using queries with sub-categories:
Check “Use queries” switcher and enter the queries.
To force Google to search for particular companies only, enclose the term between quotation marks ” “. The ” “ operator is typically used around stop words (words that Google would otherwise ignore) or when you want Google to return only those pages that match your search terms exactly.
After clicking the button “Extract data…” you will see the task estimate and the queries.
It’s recommended to click and open a few queries to check how it looks on Google Maps site.
There are two things you should follow to control the expected number of results.
1. Organizations per query limit – the limit of organizations to take from one query.
2. Number of queries – the amount of search queries you’re going to make.
There are 6 queries the bot will make to extract the data from 2 categories and 3 locations.
Therefore, the resulting amount will be no more than 480 organizations (limit of 80 * 6 queries).
Yes. Only unique organizations inside one task.
Yes, you can drop duplicates by using “Drop duplicates” checkbox (advanced parameters). Alternatively, you can drop it by yourself by using “google_id” or “place_id” fields as unique identifiers for a place.
The exact number of results will be known only after the extraction.
You can use “Total places limit” to limit the final amount of results scraped.
Questions, special needs, issues... Always happy to hear from you.