Using Python to create 1000 GSC properties in 3 seconds! BrightonSEO Oct. 2024

Slide 1

Slide 1 text

Using Python to create 1000 GSC properties in 3 seconds! Sajjad Azizzadehfahimi Senior SEO Manager Speakerdeck.com/saji @sajjad-azizzadeh-fahimi Mastodon.social/@sajjeo

Slide 2

Slide 2 text

#brightonseo Who Am I?

Slide 3

Slide 3 text

#brightonseo S A J J A D A Z I Z Z A D E H F A H I M I

Slide 4

Slide 4 text

#brightonseo S A J J A D A Z I Z Z A D E H F A H I M I

Slide 5

Slide 5 text

#brightonseo S A J J A D A Z I Z Z A D E H F A H I M I Saji

Slide 6

Slide 6 text

#brightonseo Mastodon.social/@sajjeo Linkedin: sajjad-azizzadeh-fahimi

Slide 7

Slide 7 text

#brightonseo Mastodon.social/@sajjeo Linkedin: sajjad-azizzadeh-fahimi

Slide 8

Slide 8 text

#brightonseo Mastodon.social/@sajjeo Linkedin: sajjad-azizzadeh-fahimi

Slide 9

Slide 9 text

#brightonseo Let’s dig into the serious stuﬀ… Mastodon.social/@sajjeo Linkedin: sajjad-azizzadeh-fahimi

Slide 10

Slide 10 text

● Why do you need to have more properties in GSC? ● What is the best way to create more properties? ● Step-by-step guide on implementing Python basics ● How can it help to pull out more data from GSC? ● The more data you get, the more options you have.

Slide 11

Slide 11 text

#brightonseo What is GSC? Kidding?! Obviously

Slide 12

Slide 12 text

#brightonseo What is GSC’s real power?

Slide 13

Slide 13 text

#brightonseo Reliable DATA

Slide 14

Slide 14 text

#brightonseo Reliable DATA But, is it really reliable?

Slide 15

Slide 15 text

#brightonseo Search Engine Roundtable Google Search Console Only Shows 35% Of Your Data! It Depends, Says Google.

Slide 16

Slide 16 text

Test #1 Which of these examples provides the most accurate data for this page example.com/page ? a. GSC ﬁltering feature in the main property (e.g Property: example.com) b. Separated property for /page (e.g. Property: example.com/page) c. Both options a & b are giving the same result a b

Slide 17

Slide 17 text

Slide 18

Slide 18 text

#brightonseo Source Mastodon.social/@sajjeo Linkedin: sajjad-azizzadeh-fahimi

Slide 19

Slide 19 text

Search Console API Main problem 2,000 URL requests per day on each the “Property”

Slide 20

Slide 20 text

Why Use Python in GSC? Advantages of Python - Easy to learn and use - Extensive libraries and frameworks - Strong community support - Ideal for automation tasks Get rid of Manual works

Slide 21

Slide 21 text

#brightonseo You’ve been asked to Add 100 URLs And verify in GSC Mastodon.social/@sajjeo Linkedin: sajjad-azizzadeh-fahimi

Slide 22

Slide 22 text

#brightonseo GSC list to verify ● https://www.example.com/1 ● https://www.example.com/2 ● https://www.example.com/3 ● https://www.example.com/4 ● https://www.example.com/5 ● https://www.example.com/6 ● https://www.example.com/7 ● https://www.example.com/8 ● https://www.example.com/9 ● https://www.example.com/10 ● https://www.example.com/11 ● https://www.example.com/12 ● https://www.example.com/13 ● https://www.example.com/14 Mastodon.social/@sajjeo Linkedin: sajjad-azizzadeh-fahimi

Slide 23

Slide 23 text

#brightonseo 3 sec with Python Mastodon.social/@sajjeo Linkedin: sajjad-azizzadeh-fahimi

Slide 24

Slide 24 text

#brightonseo Let’s get started!

Slide 25

Slide 25 text

#brightonseo Install Python Install Python from here: https://www.python.org/dow nloads/ Python Installation Install the Required Libraries Google Cloud Account (API Calls) pip installation

Slide 26

Slide 26 text

#brightonseo Check if installed Check Python Version Installed version Python Installation Install the Required Libraries Google Cloud Account (API Calls) pip installation

Slide 27

Slide 27 text

#brightonseo Install pip Install pip from here: https://pip.pypa.io/en/stable/installation/ Python Installation Install the Required Libraries Google Cloud Account (API Calls) pip installation

Slide 28

Slide 28 text

#brightonseo Install Required Libraries Required Libraries: ● google-api-python-client ● google-auth-httplib2 ● Google-auth-oauthlib pip install --upgrade google-api-python-client google-auth-httplib2 google-auth-oauthlib Terminal code Python Installation Install the Required Libraries Google Cloud Account (API Calls) pip installation

Slide 29

Slide 29 text

#brightonseo Verify installation Python Installation Install the Required Libraries Google Cloud Account (API Calls) pip installation Required Libraries: ● google-api-python-client ● google-auth-httplib2 ● Google-auth-oauthlib pip show google-api-python-client pip show google-auth-httplib2 pip show google-auth-oauthlib Terminal code

Slide 30

Slide 30 text

#brightonseo Create a new project in Google Cloud Python Installation Install the Required Libraries Google Cloud Account (API Calls) pip installation 1 APIs and Services -> Enable APIs and Services 2 Enable “Google Search Console API” 3 Create OAuth consent screen & OAuth client ID 4 Download OAuth client secret JSON ﬁle 5 Google Cloud Account

Slide 31

Slide 31 text

#brightonseo Create a new project in Google Cloud Python Installation Install the Required Libraries Google Cloud Account (API Calls) pip installation 1 Google Cloud Account

Slide 32

Slide 32 text

Slide 33

Slide 33 text

Slide 34

Slide 34 text

Slide 35

Slide 35 text

#brightonseo Create a new project in Google Cloud Google Cloud Account Python Installation Install the Required Libraries Google Cloud Account (API Calls) pip installation 1 APIs and Services -> Enable APIs and Services 2 Enable “Google Search Console API” 3 Create OAuth consent screen & OAuth client ID 4 Download OAuth client secret JSON ﬁle 5

Slide 36

Slide 36 text

Test #2 What is the Daily limit of GSC API requests? a. 100 b. 500 c. 2,000 d. No daily limit Mastodon.social/@sajjeo Linkedin: sajjad-azizzadeh-fahimi

Slide 37

Slide 37 text

Test #2 What is the Daily limit of GSC API requests? a. 100 b. 500 c. 2,000 d. No daily limit Mastodon.social/@sajjeo Linkedin: sajjad-azizzadeh-fahimi

Slide 38

Slide 38 text

#brightonseo Let’s get back to this request

Slide 39

Slide 39 text

#brightonseo Solution…

Slide 40

Slide 40 text

#brightonseo Adding (& verifying) Multiple Properties in GSC

Slide 41

Slide 41 text

#brightonseo Verifying GSC properties with Python Mastodon.social/@sajjeo Linkedin: sajjad-azizzadeh-fahimi

Slide 42

Slide 42 text

#brightonseo Verifying GSC properties with Python Authentica tion List of URLs to add & verify in GSC Mastodon.social/@sajjeo Linkedin: sajjad-azizzadeh-fahimi

Slide 43

Slide 43 text

#brightonseo Verifying GSC properties with Python Then add these lines in your Terminal: 1. cd /Users/saji/Desktop/PythonGSC/ (location of Python ﬁle) 2. python3 add_properties.py (calling Python ﬁle we created in last slide) cd /Users/saji/Desktop/PythonGSC/ python3 add_properties.py Terminal code

Slide 44

Slide 44 text

#brightonseo Now the MAGIC happens

Slide 45

Slide 45 text

#brightonseo MAGIC

Slide 46

Slide 46 text

#brightonseo Crawl request (Index request) in bulk

Slide 47

Slide 47 text

#brightonseo Crawl request (Index request)

Slide 48

Slide 48 text

#brightonseo Why does it matter To have more GSC properties?

Slide 49

Slide 49 text

More GSC properties = More DATA requests available

Slide 50

Slide 50 text

Hypothetical Situation Consider a website with this structure: 1. Example.com/products/ a. Number of pages under /products/ = 2,000 2. Example.com/blog/ a. Number of pages under /blog/ = 2,000 3. Example.com/pcp/ a. Number of pages under /pcp/ = 2,000

Slide 51

Slide 51 text

#brightonseo If you had only one GSC property

Slide 52

Slide 52 text

#brightonseo & wanted to crawl website to get GSC data

Slide 53

Slide 53 text

#brightonseo You wouldn’t be able to get data for 4,000 URLs

Slide 54

Slide 54 text

#brightonseo Because You used 2,000 requests on that day

Slide 55

Slide 55 text

Same is true about

Slide 56

Slide 56 text

And any other crawling tools that use GSC Inspection API

Slide 57

Slide 57 text

Test #3 How many GSC property per account? a. 200 b. 1,000 c. 650 d. No limit Mastodon.social/@sajjeo Linkedin: sajjad-azizzadeh-fahimi

Slide 58

Slide 58 text

Test #3 How many GSC property per account? a. 200 b. 1,000 c. 650 d. No limit Mastodon.social/@sajjeo Linkedin: sajjad-azizzadeh-fahimi

Slide 59

Slide 59 text

Sum up & Next steps

Slide 60

Slide 60 text

#brightonseo ● Request index in bulk with Indexing API ● Create as many properties as you want in GSC (1,000 uplimit/account) ● Use vast amount of daily GSC internal data (up to 2,000,000 daily requests) Mastodon.social/@sajjeo Linkedin: sajjad-azizzadeh-fahimi

Slide 61

Slide 61 text

#brightonseo ● Have history of issues in page level (Crawled but not indexed and etc.) ● Export Server Log File and crawl the pages with the most crawl requests from Bots Mastodon.social/@sajjeo Linkedin: sajjad-azizzadeh-fahimi

Slide 62

Slide 62 text

All the best! You can get the step-by-step guideline from here Speakerdeck.com/saji @sajjad-azizzadeh-fahimi Mastodon.social/@sajjeo THANKS