Outscraper FAQ
Umum
Scraping, harvesting, or extracting is the process of getting all the information from some public site. It automates manual exporting of the data.
The scraping and extracting of public data is protected by the First Amendment of the United States Constitution. The Ninth Circuit Court of Appeals ruled that automated scraping of publicly accessible data does not violate the Computer Fraud and Abuse Act (CFAA). Although, you should seek the counsel of an attorney on your specific matter to comply with the laws in your jurisdiction.
Check out the Dokumen API or visit the GitHub page to get insider tips on how you can integrate services with your code. Check out the blog.

We’re extracting only publicly available data, and the scraper works as a browser for data scientists, developers, and marketers.
Mekanisme untuk menjamin data bebas PII adalah dengan memilih kolom apa yang ingin Anda kembalikan.
Pembayaran & Langganan
Free Tier is the amount of usage you can use for free each month. For example, some products has a Free Tier with 500 requests per month. This means any usage of the product below 500 requests during a month will be free.
When a subscription is finalized, you will receive an invoice for the usage of pelayanan selama periode berlangganan.
In the event that you’re not able to make a payment within 3 days the system will try to charge you automatically.
- Before adding credits, make sure you entered your details on the billing information page (in case you need it in invoices or PO).
- Arahkan ke your profile page.
- Enter the number of credits you want to add.
- Choose the payment method you want to use in order to add credits (credit card, PayPal, etc.).
- After clicking the button with your payment method, follow the steps of the payment method provider.
Once you have some usage, you can see the upcoming invoice on Halaman Profil. Once you have the amount due, you can generate the invoice manually by clicking “Generate Invoice”, or it will be generated automatically within 30 days.
Once you add credits to your account (prepaid option), you will receive the receipt for the transaction by email.
Invoices with the usage of specific services will be generated after each billing period (30 days). Alternatively, once you have the amount due, you can generate the invoice manually by clicking “Generate Invoice” on Halaman Profil.
Yes. Outscraper will charge your account balance $10 and issue an additional invoice with the amount due.
No. The task will be finished, and if the task usage is greater than your account credits, you will simply receive an invoice with the outstanding usage.
Anda bisa menggunakan limit untuk membatasi jumlah data yang diekstrak.
- Membuka Platform Outscraper.
- Arahkan ke Billing Information page.
- Enter the necessary billing information you want to see on your invoices.
- Click the Save button. All your future invoices will be created with the information you have entered.
API
The limit of queries per second depends on the nature of the requests, the service, and the request parameters (amount of results, number of queries, etc.). The average QPS is about 20 (soft limit). However, Outscraper can scale according to your needs. Please contact the team in case you need a higher QPS.
Ya. API mendukung pengelompokan dengan mengirimkan array hingga 25 kueri (misalnya, query=text1&query=text2&query=text3). It allows multiple queries to be sent in one request and saves on network latency.
Arahkan ke Halaman Riwayat Penggunaan API untuk melihat permintaan terbaru Anda.
Arahkan ke halaman profil->API token untuk membuat kunci baru.
Waktu respons rata-rata adalah 3-5 detik. Tetapi mungkin tergantung pada jenis layanan (kecepatan dioptimalkan atau tidak) dan jumlah kueri per permintaan (opsi batch).
There are a few key points you should follow to increase the throughput of the API.
- Make sure you are using the latest versions of the API endpoints. For example, prefer using Places API V2 instead of Places API V1. In the case of using SDK the last version of API will be used by default (e.g. google_maps_search()).
- Use batching to send up to 25 queries per one request (e.g., query=text1&query=text2&query=text3). It allows multiple queries to be sent in one request and save on network latency time.
- Run requests in parallel. Check out this example.
- Use a webhook to fetch results once it’s ready.
Some tasks can take time to extract the data. There are a few ways to handle timeouts.
- Use retries. Expect that some number of scraping requests might return an error or timeout. Usually, trying one more time solves the issue.
- Use async requests. A good practice is to send async requests and start checking the results after the estimated execution time. Check out this Python implementation as an example.
- Use a webhook to fetch results once it’s ready.
Pengikis Google Maps
Terkadang Google menambahkan kategori lain ke pencarian Anda. Misalnya, ketika Anda mencari restoran, you might see bar, kopi toko-tokoatau bahkan hotel. This might lead to irrelevant data, especially when you are using minor categories like kolam renang.
Outscraper memberi Anda dua alat yang dapat Anda gunakan untuk menghilangkan kategori tersebut.
Kategori tengara di Google Maps
Gunakan "kecocokan yang tepat” checkbox. The parameter specifies whether to return only the categories you selected or everything that Google shows. Make sure you are using the right categories by opening similar places on Google and checking the category.
Menyaring hasil
Filter hasil dengan menerapkan Filter to the subtypes column. Such filters can eliminate all the irrelevant data and return only what you need. To avoid empty results, make sure you are familiar with the values of the fields before using the Filters.
Ada beberapa kasus ketika lokasi atau/dan kategori yang telah ditentukan sebelumnya tidak cukup. Gunakan opsi "Lokasi khusus" atau/dan "Kategori khusus" untuk memasukkan kategori atau/dan lokasi yang Anda butuhkan.
There is a limitation in Google Maps that shows only up to 400-500 places per one query search. This may be a problem when there are more companies in one category. For example, for the query “restoran, Brooklyn”.
To overcome this, we suggest splitting the location into sub-locations. For example, by using postal codes:
”restoran, Brooklyn 11203”,
”restoran, Brooklyn 11211”,
”restoran, Brooklyn 11215”,
…
Atau menggunakan kueri dengan subkategori:
…
Check the “Use queries” switcher and enter the queries.
Untuk memaksa Google mencari perusahaan tertentu saja, lampirkan istilah di antara tanda kutip ” “. NS ” “ operator biasanya digunakan di sekitar kata berhenti (kata-kata yang akan diabaikan oleh Google) atau ketika Anda ingin Google mengembalikan hanya halaman yang sama persis dengan istilah pencarian Anda.
Setelah mengklik tombol "Ekstrak data ..." Anda akan melihat perkiraan tugas dan kueri.
Disarankan untuk mengklik dan membuka beberapa kueri untuk memeriksa tampilannya di situs Google Maps.
Ada dua hal yang harus Anda ikuti untuk mengontrol jumlah hasil yang diharapkan.
1. Organisasi per batas kueri – batas organisasi untuk mengambil dari satu kueri.
2. Jumlah pertanyaan – jumlah kueri penelusuran yang akan Anda buat.
Ada 6 kueri yang akan dibuat bot untuk mengekstrak data dari 2 kategori dan 3 lokasi.
Oleh karena itu, jumlah yang dihasilkan tidak akan lebih dari 480 organisasi (batas 80 * 6 kueri).
Anda bisa menghapus duplikat dalam satu tugas dengan memilih kotak centang "Drop duplicates".
Yes, you can drop duplicates inside one task by using the “Drop duplicates” checkbox (advanced parameters). Alternatively, you can drop it yourself by using the “google_id” or “place_id” fields as unique identifiers for a place.
Jumlah pasti hasil akan diketahui hanya setelah ekstraksi.
Anda dapat menggunakan "Batas tempat total" untuk membatasi jumlah hasil akhir yang tergores.
Yes. You can use the following link as a query: “https://www.google.com/maps/search/real+estate+agency/@41.4034,2.1718413,17z" di mana Anda bisa menentukan kueri (real+estate+agency), koordinat (41.4034,2.1718413) dan tingkat zoom (17z). Anda dapat menemukan nilai-nilai ini saat mengunjungi Google Maps.
Alternatively, you can use the “coordinates” parameter if you are using the API.
Ya. Anda bisa menggunakan Pengikis Email & Kontak bersama dengan Google Maps scraper untuk memperkaya data dari Google. Untuk melakukannya, pilih "Emails & Contacts Scraper" di bagian "Enrich by other services" pada Halaman Scraper Google Maps.
You will pay only for the results you extract, no matter how many queries you make.
Tidak. Tidak ada informasi publik tentang email yang terhubung dengan daftar di Google Maps. Outscraper menggunakan sumber eksternal untuk menemukan email tersebut.
Ya. Anda bisa menggunakan filter dari parameter lanjutan dengan operator berikut ini.
You can split your tasks by city/state or some other unique attributes. For example, you can extract places from New York in the first task and places from California in the second task.
Hubungi kami
Pertanyaan, kebutuhan khusus, masalah... Selalu senang mendengar dari Anda.