I don’t like steams discovery system. It’s not good, and the numbers show that most devs don’t get any exposure.
Steam has a Pareto skew problem: the top games get all the attention, and the long tail of games get none.
Steam also has a large undiagnosed observer biasinspection bias problem, where there’s a large contingent of people who spend a lot of time on games but their recommendations are absolutely god awful for normal players. But they make up all the metrics (play time, games played, achievements, etc), so in most algorithms they’ll be over represented. This effect gets stronger the more niche a game is.
Steams user tags are also kinda awful. They’re a total kitchen sink: I played Crimson Desert, now steam recommends the “dragon” tag for me. Well, the top “dragon” games are not at all like an action game that happens to have dragons. Same with “horses” tag. This is somewhere that better tag weighting could help, but also the combination of tags is hugely important.
Sometimes I don’t open steam for more than a year, my recommendations in discovery queue are so far removed from what I want it’s insane.
Is there a steam tag database? Would be fun to play with their data.
I would like them to separate genre out of the tag system and curate the list of genres themselves, create strict guidelines for devs to select genres for their games, and let customers discover games via genre instead of tags. IMO the tag system is the worst thing they’ve ever added to the store.
Unsure how I feel about this
I don’t like steams discovery system. It’s not good, and the numbers show that most devs don’t get any exposure.
Steam has a Pareto skew problem: the top games get all the attention, and the long tail of games get none.
Steam also has a large undiagnosed
observer biasinspection bias problem, where there’s a large contingent of people who spend a lot of time on games but their recommendations are absolutely god awful for normal players. But they make up all the metrics (play time, games played, achievements, etc), so in most algorithms they’ll be over represented. This effect gets stronger the more niche a game is.Steams user tags are also kinda awful. They’re a total kitchen sink: I played Crimson Desert, now steam recommends the “dragon” tag for me. Well, the top “dragon” games are not at all like an action game that happens to have dragons. Same with “horses” tag. This is somewhere that better tag weighting could help, but also the combination of tags is hugely important.
Sometimes I don’t open steam for more than a year, my recommendations in discovery queue are so far removed from what I want it’s insane.
Is there a steam tag database? Would be fun to play with their data.
Edit: inspection bias not observer bias
I would like them to separate genre out of the tag system and curate the list of genres themselves, create strict guidelines for devs to select genres for their games, and let customers discover games via genre instead of tags. IMO the tag system is the worst thing they’ve ever added to the store.