Outscraper F.A.Q.

General

Scraping, harvesting, or extracting is a process of getting all the information from some public site. It automates manual exporting of the data.
The scraping and extracting of public data is protected by the First Amendment of the United States Constitution. The Ninth Circuit Court of Appeals ruled that automated scraping of publicly accessible data does not violate the Computer Fraud and Abuse Act (CFAA). Although, You should seek the counsel of an attorney on your specific matter to comply with the laws in your jurisdiction.
Checkout مستندات API or visit جيثب page to get insides on how you can integrate services with your code. Check out the blog.
We’re extracting only publicly available data, and the scraper works as a browser for data scientist, developers, and marketers. The mechanism to guarantee PII-free data is to select what columns you want to return.

Payments & Subscriptions

The invoice will be generated based on the usage of the services during the billing period (30 days). The prices are listed on the page.
Free Tier is the amount of usage you can use for free each month. For example, some product X has a Free Tier with 500 requests per month. This means any usage of the product below 500 requests during a month will be for free.
When a subscription will be finalized you will receive an invoice for the usage of the services during the subscription period. In case you’re not able to make a payment within 3 days the system will try to charge you automatically.
Once you have some usage you can see the upcoming invoice on the Profile Page. Once you have the amount due, you can generate the invoice manually by clicking “Generate Invoice” or it will be generated automatically within 30 days.
Once you add credits to your account (prepaid option) you will receive the receipt for the transaction by email. Invoices with the usages of specific services will be generated after each billing period (30 days). Alternatively, once you have the amount due, you can generate the invoice manually by clicking “Generate Invoice” on the Profile Page.

Yes. Outscraper will charge your account balance for $10 and issue an additional invoice with the amount due.

No. The task will be finished and if the task usage will be greater than your account credits you simply will receive an invoice with the outstanding usage.

You can use limits to limit the amount of extracted data.

API

The limit of queries per second (QPS) depends on the nature of the requests (service, the limit of results, etc.). The average QPS is about 20. اتصل بنا in case you need even more.

Yes. API supports batching by sending arrays with up to 25 queries (e.g., query=text1&query=text2&query=text3). It allows multiple queries to be sent in one request and save on network latency time.

Navigate to the API Usage History page to see your latest requests.

Navigate to profile page->API token to create a new key.

The average response time is 3-5 seconds. But it might depend on the service (speed optimized or no) type and the number of queries per request (batch option).

Google Maps Scraper

Sometimes Google adds other categories to your searches. For example, when you search for restaurants you might see bars, coffee shops, or even hotels. This might lead to irrelevant data, especially when you are using some minor categories like swimming pools.

Outscraper provides you with two tools that you can use to eliminate those categories.

  1. The landmark category on Google Maps

    Use the “exact match” checkbox. The parameter specifies whether to return only the categories you selected or everything that Google shows. Make sure you are using the right categories by opening similar places on google and checking the category.

  2. Filtering the results

    Filter results by applying Filters to the subtypes column. Such filters can eliminate all the irrelevant data and return you only what you need. To avoid empty results, make sure you are familiar with the values of the fields before using the Filters.

There are some cases when predefined locations or/and categories aren’t enough. Use “Custom locations” or/and “Custom categories” options to insert the categories or/and locations you need.
There is a limitation from Google Maps that shows only up to 400-500 places per one query search. This may be a problem when there are more companies in one category. For example, for query “restaurants, Brooklyn”. To overcome this we suggest splitting the location into sub-locations. For example, by using postal codes: ”restaurants, Brooklyn 11203”, ”restaurants, Brooklyn 11211”, ”restaurants, Brooklyn 11215, … Or using queries with sub-categories: “Asian restaurants, Brooklyn”, “Italian restaurants, Brooklyn”, “Mexican restaurants, Brooklyn”, …
Check “Use queries” switcher and enter the queries.
To force Google to search for particular companies only, enclose the term between quotation marks ” “. ال ” “ operator is typically used around stop words (words that Google would otherwise ignore) or when you want Google to return only those pages that match your search terms exactly.
After clicking the button “Extract data…” you will see the task estimate and the queries. It’s recommended to click and open a few queries to check how it looks on Google Maps site.
There are two things you should follow to control the expected number of results. 1. Organizations per query limit – the limit of organizations to take from one query. 2. Number of queries – the amount of search queries you’re going to make. There are 6 queries the bot will make to extract the data from 2 categories and 3 locations. Therefore, the resulting amount will be no more than 480 organizations (limit of 80 * 6 queries).

You can remove duplicates in one task by selecting the “Drop duplicates” checkbox.

Yes, you can drop duplicates inside one task by using the “Drop duplicates” checkbox (advanced parameters). Alternatively, you can drop it by yourself by using “google_id” or “place_id” fields as unique identifiers for a place.

The exact number of results will be known only after the extraction. You can use “Total places limit” to limit the final amount of results scraped.
Yes. You can use the following link as a query “https://www.google.com/maps/search/real+estate+agency/@41.4034,2.1718413,17z” where you can specify a query (real+estate+agency), the coordinates (41.4034,2.1718413) and zoom level (17z). You can find these values while visiting Google Maps. Alternatively, you can use the “coordinates” parameter if you are using API.
Yes. You can use Emails & Contacts Scraper along with Google Maps scraper to enrich the data from Google. In order to do so, select “Emails & Contacts Scraper” in the “Enrich by other services” section on the Google Maps Scraper page.
You will pay only for the results you extracted no matter how many queries.

No. There is no public information about emails connected with the listing on Google Maps. Outscraper uses external sources to find those emails.

Yes. You can use filters from the advanced parameters with the following operator.

You can split your tasks by city/state or by some other unique attributes. For example, you can extract places from New York in the first task, and extract the places from California in the second task.

اتصل بنا

أسئلة ، احتياجات خاصة ، قضايا .. يسعدنا دائمًا سماع رأيك.