Profile

Cover photo
Verified name
John Mueller
Lived in Switzerland
50,299 followers|10,914,582 views
AboutPostsReviews
Story
Introduction
The views expressed here are my own, and not those of my employer. 
Places
Map of the places this user has livedMap of the places this user has livedMap of the places this user has lived
Previously
Switzerland
Work
Occupation
Webmaster Trends Analyst
Basic Information
Birthday
October 30
Other names
JohnMu

Stream

John Mueller

Shared publicly  - 
 
Another call to not limit crawling ... 
5
Patrick Le Cam's profile photo
 
Or stopping bot eating dirt :-)
Add a comment...

John Mueller

Shared publicly  - 
 
With all the back & forth on robots.txt, I ran across +Joost de Valk's post from earlier this year about his robots.txt file. It's pretty empty, read his post to find out why. Good stuff! 

https://yoast.com/wordpress-robots-txt-example/
9
4
Michael Schöttler's profile photoSimone Tomiozzo's profile photoMary Stovall's profile photoDenis Sinegubko's profile photo
2 comments
 
Robots.txt 101

Excellent write up by +Joost de Valk. H/t +John Mueller
Add a comment...

John Mueller

Shared publicly  - 
 
This is crazy. Get those web-pages - HTML, JS, CSS, etc - under control, folks. 
22
6
Vishal Sharma's profile photoBill Slawski's profile photoBorislav Arapchev's profile photogeorge oloo's profile photo
3 comments
 
That's only the shareware version of Doom though; it's not like it's the full game or anything silly.
Add a comment...

John Mueller

Shared publicly  - 
 
Here's a new YouTube channel by a pair of Googlers on a mission to expose all of our secrets. Well, some of them at least. Fun & cool, check out the two existing videos and subscribe so that you don't miss the new ones. 
26
4
Jacob Loeb (loebjack)'s profile photoKerstin Reichert's profile photoLe Hung (レフン)'s profile photoMark Taylor's profile photo
3 comments
 
My dream is to work in a company as google....
Add a comment...

John Mueller

Shared publicly  - 
 
Heute um 13:00 geht's weiter mit dem naechsten Webmaster Sprechstunden Hangout. Ihr koennt noch eure Fragen eintragen, und seid natuerlich auch eingeladen, persoenlich mitzumachen! 
 ·  Translate
 
Donnerstag gibt's hier wieder ein Google Webmaster Central Hangout auf Deutsch

Thema: Fragen koennt ihr hier auf der Event-Seite erfassen. Ich bin offen fuer alles Google/Webmaster-bezogene, z.B. Google’s Crawling & Indexing, Duplicate Content, Sitemaps, Search Console, Mehrsprachige & internationale Websites, usw. 

Wo: Hier auf Google+. Mehr ueber Hangouts findet ihr unter https://sites.google.com/site/webmasterhelpforum/en/office-hours  -- eine Webcam ist praktisch, aber nicht notwendig. 
 ·  Translate
This Hangout On Air is hosted by Google Webmasters. The live video broadcast will begin soon.
Q&A
Preview
Live
German / Google Webmaster Central Sprechstunden-Hangout auf Deutsch
Yesterday, July 30, 7:00 AM
Hangouts On Air - Broadcast for free

4 comments on original post
6
2
SEO-Portal's profile photoWaqar Ahmed's profile photoMichael Schöttler's profile photoGabi Fischer's profile photo
4 comments
 
+Waqar Ahmed here is the english translation of the german Hangout :) http://seo-portal.de/2015/07/31/deutsches-hangout-transkript-30-07-2015/
Add a comment...

John Mueller

Shared publicly  - 
 
I see a bunch of posts about the robotted resources message that we're sending out. I haven't had time to go through & review them all (so include URLs if you can :)), but I'll spend some time double-checking the reports tomorrow. 

Looking back a lot of years, blocking CSS & JS is something that used to make sense when search engines weren't that smart, and ended up indexing & ranking those files in search. For a long time now, that's no longer the case  (happy to get reports if you do see it though), and nowadays it's extremely helpful to be able to access CSS & JS files so that we understand what a page really looks like. Is it mobile-friendly? Is there content that we'd miss without JavaScript? Blocked CSS & JS files are some of the bigger problems that we run across in the meantime.

Search Console gives you tools to find blocked content across your site, to test individual pages to see if all embedded content is accessible, and to test your robots.txt files to find why a specific URL is blocked (and to submit an updated robots.txt so that we can crawl it ASAP). We've also documented this problem in various ways over time, for example in https://developers.google.com/webmasters/mobile-sites/mobile-seo/common-mistakes/blocked-resources 

That said, we hear you that these messages aren't as clear as they could be, and we'll double-check your reports (here on G+, on Twiter, in the forums, etc) to see what we can do to improve that. 
60
36
Peggy K's profile photoCassiano Travareli's profile photoDavid Carralon's profile photoSaurabh Rawat's profile photo
27 comments
 
+David Iwanow yes I confirm it works 
Add a comment...

John Mueller

Shared publicly  - 
 
 
Good advice by Microsoft: Ten Immutable Laws of Security (Version 2.0). I agree by and large, except for Law #8 ...

h/t +Kristian Köhntopp 
Ten Immutable Laws Of Security (Version 2.0). Here at the Microsoft Security Response Center, we investigate thousands of security reports every year. In some cases, we find that a report describes a bona fide security vulnerability resulting from an issue in one of our products; ...
5 comments on original post
3
1
Bill Slawski's profile photo
Add a comment...

John Mueller

Shared publicly  - 
 
 
Wurde eure Website jemals gehackt?

Ihr könnt gern einen Kommentar hinterlassen, um eure Erfahrung damit zu teilen!
#nohacked  
 ·  Translate
23 votes  -  votes visible to Public
39%
61%
Ja
39%
Nein
61%
1 comment on original post
2

John Mueller

Shared publicly  - 
 
The next webmaster office hours hangout is taking place in about an hour. If there's a webmaster / websearch question that's been on your mind recently, make sure it's submitted in the Q&A! If you haven't been able to join these recently, and would like to join us live, please leave a comment on the event entry so that I can add you a bit before we start. 

See you there!
 
Join us for a Google Webmaster Central office hours hangout :)

Add your questions to this event page, this session is open to anything webmaster related like crawling, indexing, mobile sites, internationalization, duplicate content, Sitemaps, Search Console, pagination, duplicate content, multi-lingual/multi-regional sites, etc. 

This is a Hangout on Air on Google+. It works best with a webcam + headset. You can find out more about Hangouts and how to participate at https://sites.google.com/site/webmasterhelpforum/en/office-hours 

Feel free to drop by - we welcome webmasters of all levels! If you would like to join this hangout live & in person, and haven't been able to get in recently, please leave a note here and we'll try to invite you a few minutes before we start.
This Hangout On Air is hosted by Google Webmasters. The live video broadcast will begin soon.
Q&A
Preview
Live
English Google Webmaster Central office-hours hangout
Today, July 31, 5:00 AM
Hangouts On Air - Broadcast for free

19 comments on original post
3
4
Michael Schöttler's profile photoEvelyn Leu's profile photo
Add a comment...

John Mueller

Shared publicly  - 
 
Robots have changed over the years, but this is still one awesome tune.
23
Steve Dowe's profile photoSasch Mayer's profile photo
2 comments
 
This track brings back a huge number of memories... It's part of the soundtrack to my childhood...

Thanks for making me feel old. ;-)
Add a comment...

John Mueller

Shared publicly  - 
 
 
Falls eure Website gehackt wurde, solltet ihr euren Hosting-Provider um Unterstützung bitten. Die Wahrscheinlichkeit ist hoch, dass ihr über diesen Weg Hilfe beim Bereinigen des Hacks erhaltet!
 
Quelle: https://www.stopbadware.org/files/compromised-websites-an-owners-perspective.pdf

#nohacked  
 ·  Translate
View original post
4
Add a comment...

John Mueller

Shared publicly  - 
 
I noticed there's a bit of confusion on how to tweak a complex robots.txt file (aka longer than two lines :)). We have awesome documentation (of course :)), but let me pick out some of the parts that are commonly asked about:

- Disallowing crawling doesn't block indexing of the URLs. This is pretty widely known, but worth repeating.

- More-specific user-agent sections replace less-specific ones. If you have a section with "user-agent: *" and one with "user-agent: googlebot", then Googlebot will only follow the Googlebot-specific section. 

- More-specific directives trump less-specific ones. We look at the length of the "path-part". For example, "allow: /javascript.js" will trump "disallow: /java", but "allow: *.js" won't. 

- The paths / URLs in the robots.txt file are case-sensitive. 

For non-trivial files, tweaking can be a bit tricky. I strongly recommend using the robots.txt Tester in Search Console - it will pinpoint the line that blocks any specific URL, lets you test changes directly, and is the fastest way to let Google know of a changed robots.txt file on your site. Find out more about the tool at https://support.google.com/webmasters/answer/6062598

Here's the full documentation: https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt 
70
38
Stefano Rigazio's profile photoRiccardo Perini's profile photoTod Su's profile photoFabio Limatola's profile photo
9 comments
 
I think most of the webmasters out there are looking for a solution, not for all possibilitys and the understanding of the science of crawling.

To be honest: The google documentation is reaaaly good! But its complex too. There is no "quick solution" inside. Thats why most of the webmasters out there are still confused even there is a bunch of good documentations.
Add a comment...
Quality: ExcellentAppeal: Very GoodService: Excellent
Public - 2 years ago
reviewed 2 years ago
2 reviews
Map
Map
Map