Hello everyone! Just wanted to give an update for the indexing issues many have experienced. We know it’s the most frequent pain point new developers have publishing content on itch.io. We’re sorry it’s taken so long to fully address.

Our “needs review” internal flag system was originally designed to be very cautious. We have a series of classifiers and heuristics that run on every published and edited page to see if there’s something about the page that would require a human to review it before it can be eligible for indexing.

We get a lot of scammers and spammers uploading every day. Unfortunately, the way we’ve tuned and maintained the scanner over the years has created a lot of “false positives,” legitimate projects that were stuck waiting for review, and we didn’t have the staff resources to clear out those queues manually.

We’ve spent the past week updating and tweaking our classifier rules substantially, including finding a handful of bugs along the way where pages would unfairly get tagged for review. We’re also changing our philosophy on how games get queued as well. We feel we have better secondary detection mechanisms now for malware, spam, etc. so we’re making our review requirements much less strict.

This is kind of an experiment. We’re hoping opening the floodgates doesn’t lead to a bunch of malicious pages showing up, so we’re keeping a close eye on things and will continue to tweak on a daily basis.

That said, in the past week we’ve released about 215,000 project pages that were previously blocked from being eligible for indexing. That now puts our total number of indexed pages well over 2 million. 🎉 Over the same time period we’ve suspended and banned over 10,000 accounts attempting to distribute malware and spam.

I know the next issue many people have with this system is lack of communication to the developer about their indexing status. I hope to address that soon as well. Once we get a bit more comfortable with the current set of rules, we want to make the specific reasons why a page might not be eligible to be very clear. Unfortunately there will always be a bit of mystery to how the system works, as we have malicious actors every day trying to reverse engineer our systems to figure out how to get their spam and malware to show up in front of real people.

Given the state of the world with AI and LLMs, this type of problem is only going to get harder. Bad actors have access to more resources and more sophisticated systems to circumvent protections. I just wanted to mention this to ask for your patience as we deal with this stuff. Our indexing system is by no means perfect, this is only only step towards trying to make it better. Ever since I created itch.io, it’s always been my goal to ensure that developers can freely publish pages. (Did you know Steam Greenlight was the original motivator?) I know many people discussing the indexing issues online often float around the idea that we should charge for publishing like Steam. We will not be doing this.

Thanks, if you have any feedback feel free to leave it in this thread. Please do not post any requests to review your account for indexing eligibility in this thread, support requests should be sent to support or you can post in Questions & Support.

Huzzah!

Indexing requests are by far the biggest complaint I've saw about Itch,  and as a dev I've felt always a bit uneasy with the creation of new projects if there was a chance those might've been more hidden, happy to see more tinkering on that side!

very good news

i can finally see my projects when searching, i am so happy

my game is finally getting the views its deserved but never really gotten thanks!

flabbergasted that it took this long and that it is even being fixed, the tragedy has ended but I'd much preferred this didn't happen to begin with.
the casually dropped "yeah just 200k yk small mistakes whoopsies", you don't miss this without some intentionality.

Given the state of the world with AI and LLMs, this type of problem is only going to get harder.

Oh yes.

There is even bots talking in forum. You might want to make /docs/creators/quality-guidelines#avoid-uploading-excessive-amoun... more clear and also include bot operated accounts specifically. I mean, actually the cloudflare protection asks, if a user is a bot, so ai agents already violate rules when accessing Itch at that point.

Notifying publishers about this rule with a little popup when they upload a lot, might be a good idea to discourage the honest ai enthusiasts from spamming and botting. So that it is easier to detect the bad actors.

There is a bot account with over 500 indexed projects. Now that Itch staff has more time, they could focus more on weeding out bad actors like that - without waiting on reports. Unless of course, this is the type of content creator Itch wants on the platform. Mass uploaders are easily findable and if they do not have a good reason for mass uploading, they are probably a bad actor and should be scrutinized.

We feel we have better secondary detection mechanisms now for malware

Fingers crossed. I saw over 1000 malware uploads. That were malware uploaders that were indexed. It made me sick, and I had to stop.

Thank you so much for always looking out for us and keeping this place free for all, Leafo! You're the best! 🥰

thanks for continuing to keep the page alive and healthy as the webpocalypse descends on many servers

i love hosting my games here. my biggest fear is itch going offline because it is the sole repo for so much creative effort. as time goes on I would love to see additional archival efforts in addition to indexing, since this is basically a treasure trove of creative effort that will surely never be duplicated.

thanks again!!

This is the news I've been waiting to hear!
First of, thank you for for giving me this opportunity to post games here free. For over 8 years I've been using the website, I've gained so much experience and so many friends, but the past 2 years have been difficult and I've felt lost, because of the indexing issue and flagging of my page. I'm glad this issue is being worked on and hopefully, maybe with my next game it will show up again in the most recent. 
As an advice gesture to people, who might be reading this and the OG post author, I did go way beyond the rules to be acceptable for the page - I've changed password, started using itch.io application and I've enabled 2 factor verification. It is very important to follow rules and never give up! 
Thanks again and good luck to all!

Does this have an effect on deindexed games or requests to be reindexed? There are still several games that have been unfairly deindexed since last year, such as justacarrots' "Our Wonderland", so it would be relieving to know if progress is being made on that front.