Tabella dei contenuti

Google Maps Scraping in Pure Node.js

Good level of knowledge of computer programming, browser emulation, proxies, and reCAPTCHA solver are important for extracting Google Maps. Likewise, you must be prepared to deal with any changes Google may make to its adaptive content.

In order to effectively employ browser emulation, you will first need to simulate the actions of the actual user. Using Selenio or other browser emulators may be a viable option.

Then, you will need to make use of deleghe in the second place if you want to protect the IP address of your workplace or your private residence. Because of this, you will be able to request websites from the IP addresses of other users.

You do not want your IPs switched whenever a reCAPTCHA occurs, therefore you can add a risolutore di reCAPTCHA to your system as Google may still display a reCAPTCHA and connect it to some of your IPs despite that collection of tools. This could happen even if you have a good amount of traffic.

Plus, there are times when Google may actually change the information it provides. Simple daily testing will get the job done.

Putting a scraper into effect can be an extensive process, but it can be done and developed eventually. For further information on scraping Google Maps using Python and Selenium, have a look at this detailed guide: Come raschiare Google Maps con Python e Selenium.

Google Maps Scraping With Outscraper Node.js Package

Utilizzando il Outscraper Node.js library will enhance the quality of scraping Google Maps. It provides convenient access to the Outscraper API from applications written in the Node.js language which allows you to use Servizi di Outscraper dal codice.

Si può iniziare installando il pacchetto e creare un account su Outscraper.

Installazione

Install the Outscraper SDK by running the following command:

				
					npm install outscraper --save
# Or
yarn add outscraper
				
			

Inizializzazione

Inizializzare il client Outscraper importando la classe e aggiungendo la chiave API segreta. È possibile generare la chiave API su la pagina del profilo.

				
					const Outscraper = require('outscraper');
// Or using ES modules:
import Outscraper from 'outscraper';

let client = new Outscraper('SECRET_API_KEY');
				
			

Esempi di utilizzo

Ecco alcuni esempi di come è possibile effettuare lo scraping di luoghi da Google Maps utilizzando le query di ricerca:

				
					// Search for businesses in specific locations:
client.googleMapsSearchV2(['restaurants brooklyn usa'], limit=20, language='en', region='us').then(response => {
  console.log(response);
});


// Scrap Places by Two Queries
client.googleMapsSearchV2(
  ['restaurants brooklyn usa', 'bars brooklyn usa'],
  limit=50, // limit of palces per each query
  language='en',
  region='US',
).then(response => {
  response.forEach(queryPlaces => {
    queryPlaces.forEach(place => {
      console.log('--------------------');
      console.log('query: ', place.query);
      console.log('name: ', place.name);
      console.log('phone: ', place.phone);
      console.log('site: ', place.site);
    });
  });
});
				
			

È anche possibile estrarre i dati utilizzando l'Id del luogo:

				
					// Get data of the specific place by id
client.googleMapsSearchV2(['ChIJrc9T9fpYwokRdvjYRHT8nI4'], language='en').then(response => {
  console.log(response);
});

// Scrap Places by Place Ids
client.googleMapsSearchV2(
  ["ChIJ8ccnM7dbwokRy-pTMsdgvS4", "ChIJN5X_gWdZwokRck9rk2guJ1M", "ChIJxWLy8DlawokR1jvfXUPSTUE"],
  limit=1, // limit of palces per each query
).then(response => {
  response.forEach(queryPlaces => {
    queryPlaces.forEach(place => {
      console.log('--------------------');
      console.log('name: ', place.name);
      console.log('place_id: ', place.place_id);
    });
  });
});
				
			

Provate subito l'SDK Outscraper

The Outscraper SDK has made it simple and provides an efficient way available for you to easily do Google Maps scraping with Node.js. Simply sign up to give our Free Tier a try.

FAQ

Domande e risposte più frequenti

È possibile effettuare lo scraping dei risultati di Google Map utilizzando l'SDK Outscraper. Specificare le query di ricerca, la lingua e altri parametri e inviare la richiesta.
npm install outscraper --save
# Or
yarn add outscraper
const Outscraper = require('outscraper');
// Or using ES modules:
import Outscraper from 'outscraper';

let client = new Outscraper('SECRET_API_KEY');
// Search for businesses in specific locations:
client.googleMapsSearchV2(['restaurants brooklyn usa'], limit=20, language='en', region='us').then(response => {
  console.log(response);
});


// Scrap Places by Two Queries
client.googleMapsSearchV2(
  ['restaurants brooklyn usa', 'bars brooklyn usa'],
  limit=50, // limit of palces per each query
  language='en',
  region='US',
).then(response => {
  response.forEach(queryPlaces => {
    queryPlaces.forEach(place => {
      console.log('--------------------');
      console.log('query: ', place.query);
      console.log('name: ', place.name);
      console.log('phone: ', place.phone);
      console.log('site: ', place.site);
    });
  });
});

Lo scraping di Google Maps richiede una buona conoscenza della codifica, dell'emulazione del browser, dei proxy e della risolutore di reCAPTCHA. Inoltre, dovreste essere pronti ad affrontare le modifiche che Google potrebbe apportare ai contenuti dinamici.

Google Maps non consente lo scraping. Tuttavia, lo scraping e l'estrazione di dati pubblici sono protetti dal Primo Emendamento della Costituzione degli Stati Uniti.

Categorie: API

Yunus

Marketer, Content Writer, Customer Experience Developer - Facebook | Linkedin | Twitter

ommenti

Lascia un commento

Segnaposto avatar