Table des matières

Google Maps Scraping in Pure Node.js

A good level of knowledge of computer programming, browser emulation, proxies, and reCAPTCHA solver is important for extracting Google Maps. Likewise, you must be prepared to deal with any changes Google may make to its adaptive content.

In order to effectively employ browser emulation, you will first need to simulate the actions of the actual user. Using Sélénium or other browser emulators may be a viable option.

Then, you will need to make use of Proxies in the second place if you want to protect the IP address of your workplace or your private residence. Because of this, you will be able to request websites from the IP addresses of other users.

You do not want your IPs switched whenever a reCAPTCHA occurs, therefore you can add a Solutionneur de reCAPTCHA to your system as Google may still display a reCAPTCHA and connect it to some of your IPs despite that collection of tools. This could happen even if you have a good amount of traffic.

Plus, there are times when Google may actually change the information it provides. Simple daily testing will get the job done.

Putting a scraper into effect can be an extensive process, but it can be done and developed eventually. For further information on scraping Google Maps using Python and Selenium, have a look at this detailed guide: Comment gratter Google Maps avec Python et Selenium.

Google Maps Scraping With Outscraper Node.js Package

Using the Outscraper Node.js library will enhance the quality of scraping Google Maps. It provides convenient access to the Outscraper API from applications written in the Node.js language which allows you to use Les services de Outscraper de votre code.

Vous pouvez commencer par installer le paquet et en créant un compte sur grattoir.

Installation

Install the Outscraper SDK by running the following command:

				
					npm install outscraper --save
# Or
yarn add outscraper
				
			

Initialisation

Initialisez le client Outscraper en important la classe et en ajoutant votre clé API secrète. Vous pouvez générer la clé API sur la page de profil.

				
					const Outscraper = require('outscraper');
// Or using ES modules:
import Outscraper from 'outscraper';

let client = new Outscraper('SECRET_API_KEY');
				
			

Exemples d'utilisation

Voici des exemples de la façon dont vous pouvez extraire des lieux de Google Maps en utilisant des requêtes de recherche :

				
					// Search for businesses in specific locations:
client.googleMapsSearchV2(['restaurants brooklyn usa'], limit=20, language='en', region='us').then(response => {
  console.log(response);
});


// Scrap Places by Two Queries
client.googleMapsSearchV2(
  ['restaurants brooklyn usa', 'bars brooklyn usa'],
  limit=50, // limit of palces per each query
  language='en',
  region='US',
).then(response => {
  response.forEach(queryPlaces => {
    queryPlaces.forEach(place => {
      console.log('--------------------');
      console.log('query: ', place.query);
      console.log('name: ', place.name);
      console.log('phone: ', place.phone);
      console.log('site: ', place.site);
    });
  });
});
				
			

Il est également possible d'extraire les données en utilisant Place Id :

				
					// Get data of the specific place by id
client.googleMapsSearchV2(['ChIJrc9T9fpYwokRdvjYRHT8nI4'], language='en').then(response => {
  console.log(response);
});

// Scrap Places by Place Ids
client.googleMapsSearchV2(
  ["ChIJ8ccnM7dbwokRy-pTMsdgvS4", "ChIJN5X_gWdZwokRck9rk2guJ1M", "ChIJxWLy8DlawokR1jvfXUPSTUE"],
  limit=1, // limit of palces per each query
).then(response => {
  response.forEach(queryPlaces => {
    queryPlaces.forEach(place => {
      console.log('--------------------');
      console.log('name: ', place.name);
      console.log('place_id: ', place.place_id);
    });
  });
});
				
			

Essayez Outscraper SDK maintenant

The Outscraper SDK has made it simple and provides an efficient way available for you to easily do Google Maps scraping with Node.js. Simply sign up to give our Free Tier a try.

FAQ

Questions et réponses les plus fréquentes

Vous pouvez récupérer les résultats de Google Map en utilisant Outscraper SDK. Spécifiez les requêtes de recherche, la langue et d'autres paramètres, puis envoyez votre demande.
npm install outscraper --save
# Or
yarn add outscraper
const Outscraper = require('outscraper');
// Or using ES modules:
import Outscraper from 'outscraper';

let client = new Outscraper('SECRET_API_KEY');
// Search for businesses in specific locations:
client.googleMapsSearchV2(['restaurants brooklyn usa'], limit=20, language='en', region='us').then(response => {
  console.log(response);
});


// Scrap Places by Two Queries
client.googleMapsSearchV2(
  ['restaurants brooklyn usa', 'bars brooklyn usa'],
  limit=50, // limit of palces per each query
  language='en',
  region='US',
).then(response => {
  response.forEach(queryPlaces => {
    queryPlaces.forEach(place => {
      console.log('--------------------');
      console.log('query: ', place.query);
      console.log('name: ', place.name);
      console.log('phone: ', place.phone);
      console.log('site: ', place.site);
    });
  });
});

L'exploration de Google Maps nécessite une bonne connaissance du codage, de l'émulation de navigateur, des proxies et de l'utilisation de l'Internet. Solveur de reCAPTCHA. En outre, vous devez également être prêt à faire face aux modifications que Google pourrait apporter à son contenu dynamique.

Google Maps interdit le scraping. Cependant, le grattage et l'extraction de données publiques sont protégés par le premier amendement de la Constitution des États-Unis.

Catégories : API

Yunus

Marketer, rédacteur de contenu, développeur de l'expérience client - Facebook | Linkedin | Twitter

0 Commentaire

Laisser un commentaire

Espace réservé d'avatar