Merge pull request #382 from soxoj/fix-alexa-rank

Fixed issue with str alexaRank

maigret/resources/data.json

@@ -1034,7 +1034,7 @@
             "disabled": true
         },
         "Appian": {
-            "alexaRank": "56402",
+            "alexaRank": 56402,
             "url": "https://community.appian.com/members/{username}",
             "checkType": "message",
             "absenceStrs": [

sites.md

@@ -1,5 +1,5 @@
 
-## List of supported sites (search methods): total 2595
+## List of supported sites (search methods): total 2638
 
 Rank data fetched from Alexa by domains.
 
@@ -648,6 +648,7 @@ Rank data fetched from Alexa by domains.
 1. ![](https://www.google.com/s2/favicons?domain=https://www.bookcrossing.com/) [Bookcrossing (https://www.bookcrossing.com/)](https://www.bookcrossing.com/)*: top 100K, in*
 1. ![](https://www.google.com/s2/favicons?domain=https://dota2.ru/) [Dota2 (https://dota2.ru/)](https://dota2.ru/)*: top 100K, gaming, ru*
 1. ![](https://www.google.com/s2/favicons?domain=https://forum.questionablequesting.com) [QuestionableQuesting (https://forum.questionablequesting.com)](https://forum.questionablequesting.com)*: top 100K, forum, gb, jp, us*, search is disabled
+1. ![](https://www.google.com/s2/favicons?domain=) [Appian ()]()*: top 100K*
 1. ![](https://www.google.com/s2/favicons?domain=https://dissenter.com/) [Dissenter (https://dissenter.com/)](https://dissenter.com/)*: top 100K, us*
 1. ![](https://www.google.com/s2/favicons?domain=insanejournal.com) [Insanejournal (insanejournal.com)](insanejournal.com)*: top 100K, us*
 1. ![](https://www.google.com/s2/favicons?domain=https://shazoo.ru) [Shazoo (https://shazoo.ru)](https://shazoo.ru)*: top 100K, ru*
@@ -1233,6 +1234,7 @@ Rank data fetched from Alexa by domains.
 1. ![](https://www.google.com/s2/favicons?domain=https://devtribe.ru) [Devtribe (https://devtribe.ru)](https://devtribe.ru)*: top 10M, ru*
 1. ![](https://www.google.com/s2/favicons?domain=https://forest.ru/) [Forest (https://forest.ru/)](https://forest.ru/)*: top 10M, ru*
 1. ![](https://www.google.com/s2/favicons?domain=https://shotbow.net) [Shotbow (https://shotbow.net)](https://shotbow.net)*: top 10M, ca, forum, us*, search is disabled
+1. ![](https://www.google.com/s2/favicons?domain=https://101010.pl/) [101010.pl (https://101010.pl/)](https://101010.pl/)*: top 10M*
 1. ![](https://www.google.com/s2/favicons?domain=https://otechie.com) [Otechie (https://otechie.com)](https://otechie.com)*: top 10M, finance, us*
 1. ![](https://www.google.com/s2/favicons?domain=http://www.volgogradru.com) [Volgogradru (http://www.volgogradru.com)](http://www.volgogradru.com)*: top 10M, ru*
 1. ![](https://www.google.com/s2/favicons?domain=https://pilguy.com) [Pilguy (https://pilguy.com)](https://pilguy.com)*: top 10M, forum, ru*, search is disabled
@@ -1547,23 +1549,52 @@ Rank data fetched from Alexa by domains.
 1. ![](https://www.google.com/s2/favicons?domain=http://74507.ucoz.ru) [74507.ucoz.ru (http://74507.ucoz.ru)](http://74507.ucoz.ru)*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=https://apteka.ee) [AMUR (https://apteka.ee)](https://apteka.ee)*: top 100M, dating, ru*
 1. ![](https://www.google.com/s2/favicons?domain=https://alabay.forum24.ru) [Alabay (https://alabay.forum24.ru)](https://alabay.forum24.ru)*: top 100M, forum, ru*
+1. ![](https://www.google.com/s2/favicons?domain=) [Anilist ()]()*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=https://antipunk.com/) [Antipunk (https://antipunk.com/)](https://antipunk.com/)*: top 100M, ru*
+1. ![](https://www.google.com/s2/favicons?domain=) [Arduino ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Artistsnclients ()]()*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=http://artpersona.org/) [Artpersona (http://artpersona.org/)](http://artpersona.org/)*: top 100M, ru*
+1. ![](https://www.google.com/s2/favicons?domain=) [AvidCommunity ()]()*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=https://avtoforum.org) [Avtoforum (https://avtoforum.org)](https://avtoforum.org)*: top 100M, forum, ru*
+1. ![](https://www.google.com/s2/favicons?domain=) [Bandlab ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Bentbox ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Biggerpockets ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Bitwarden ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Blogi.pl ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Bugcrowd ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Caringbridge ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Castingcallclub ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Chomikuj.pl ()]()*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=https://3examplesite.ru) [CPlusPlus (https://3examplesite.ru)](https://3examplesite.ru)*: top 100M, ru*, search is disabled
+1. ![](https://www.google.com/s2/favicons?domain=) [Crowdin ()]()*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=http://www.casial.net) [Casial (http://www.casial.net)](http://www.casial.net)*: top 100M, de*
 1. ![](https://www.google.com/s2/favicons?domain=https://www.casino-affiliate-forum.com) [Casino-affiliate-forum (https://www.casino-affiliate-forum.com)](https://www.casino-affiliate-forum.com)*: top 100M, de, forum*
 1. ![](https://www.google.com/s2/favicons?domain=http://www.chess-russia.ru) [Chess-russia (http://www.chess-russia.ru)](http://www.chess-russia.ru)*: top 100M, ru*
 1. ![](https://www.google.com/s2/favicons?domain=https://club-comedy.clan.su) [Club-comedy.clan.su (https://club-comedy.clan.su)](https://club-comedy.clan.su)*: top 100M, ru*
 1. ![](https://www.google.com/s2/favicons?domain=http://www.cssomsk.ru) [Cssomsk (http://www.cssomsk.ru)](http://www.cssomsk.ru)*: top 100M, ru*
+1. ![](https://www.google.com/s2/favicons?domain=) [Cults3d ()]()*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=https://cyberclock.cc) [Cyberclock (https://cyberclock.cc)](https://cyberclock.cc)*: top 100M, ru*
 1. ![](https://www.google.com/s2/favicons?domain=http://www.cydak.ru) [Cydak (http://www.cydak.ru)](http://www.cydak.ru)*: top 100M, ru*
+1. ![](https://www.google.com/s2/favicons?domain=) [Cytoid.io ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Demotywatory ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Dojoverse ()]()*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=https://www.designspiration.net/) [Designspiration (https://www.designspiration.net/)](https://www.designspiration.net/)*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=https://dinsk.su) [Dinsk (https://dinsk.su)](https://dinsk.su)*: top 100M, ru*, search is disabled
 1. ![](https://www.google.com/s2/favicons?domain=https://forum.djangoproject.co) [Djangoproject.co (https://forum.djangoproject.co)](https://forum.djangoproject.co)*: top 100M, coding, forum*
 1. ![](https://www.google.com/s2/favicons?domain=https://www.dublikat.shop) [Dublikat (https://www.dublikat.shop)](https://www.dublikat.shop)*: top 100M, ru*
 1. ![](https://www.google.com/s2/favicons?domain=http://eightbit.me/) [Eightbit (http://eightbit.me/)](http://eightbit.me/)*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=https://enot-poloskun.ru/) [Enot-poloskun (https://enot-poloskun.ru/)](https://enot-poloskun.ru/)*: top 100M, ru*
+1. ![](https://www.google.com/s2/favicons?domain=) [Fabswingers ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Faktopedia ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Fancentro ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Fansly ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Fedi.lewactwo.pl ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Forumprawne.org ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Fosstodon ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Fotka ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Friendfinder ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Friendfinder-x ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Furaffinity ()]()*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=http://www.fegatch.com/) [Fegatch (http://www.fegatch.com/)](http://www.fegatch.com/)*: top 100M, ru*
 1. ![](https://www.google.com/s2/favicons?domain=https://www.filmo.gs/) [Filmogs (https://www.filmo.gs/)](https://www.filmo.gs/)*: top 100M, movies*, search is disabled
 1. ![](https://www.google.com/s2/favicons?domain=https://forum.jambox.ru) [Forum.jambox.ru (https://forum.jambox.ru)](https://forum.jambox.ru)*: top 100M, forum, ru*
@@ -1574,12 +1605,24 @@ Rank data fetched from Alexa by domains.
 1. ![](https://www.google.com/s2/favicons?domain=https://gam1ng.com.br) [Gam1ng (https://gam1ng.com.br)](https://gam1ng.com.br)*: top 100M, br, webcam*, search is disabled
 1. ![](https://www.google.com/s2/favicons?domain=https://www.garagepunk.com) [GaragePunk (https://www.garagepunk.com)](https://www.garagepunk.com)*: top 100M, us*
 1. ![](https://www.google.com/s2/favicons?domain=http://www.gliger.ru) [Gliger (http://www.gliger.ru)](http://www.gliger.ru)*: top 100M, ru*, search is disabled
+1. ![](https://www.google.com/s2/favicons?domain=) [Gnome-vcs ()]()*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=https://forums.golf-monthly.co.uk/) [GolfMonthly (https://forums.golf-monthly.co.uk/)](https://forums.golf-monthly.co.uk/)*: top 100M, forum, gb, us*
 1. ![](https://www.google.com/s2/favicons?domain=http://gothic.su) [Gothic (http://gothic.su)](http://gothic.su)*: top 100M, forum, ru*
+1. ![](https://www.google.com/s2/favicons?domain=) [Gradle ()]()*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=https://www.gunandgame.co) [Gunandgame (https://www.gunandgame.co)](https://www.gunandgame.co)*: top 100M, us*, search is disabled
 1. ![](https://www.google.com/s2/favicons?domain=https://hackeralexaRank.com/) [HackeralexaRank (https://hackeralexaRank.com/)](https://hackeralexaRank.com/)*: top 100M*, search is disabled
+1. ![](https://www.google.com/s2/favicons?domain=) [Hackerrank ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Hexrpg ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Inkbunny ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Ipolska.pl ()]()*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=https://www.ingunowners.com) [Ingunowners (https://www.ingunowners.com)](https://www.ingunowners.com)*: top 100M, forum, us*
+1. ![](https://www.google.com/s2/favicons?domain=) [Jbzd ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Jeja.pl ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Jellyfin Weblate ()]()*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=http://jer.forum24.ru) [Jer.forum24.ru (http://jer.forum24.ru)](http://jer.forum24.ru)*: top 100M, forum, ru*
+1. ![](https://www.google.com/s2/favicons?domain=) [Joemonster ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Karab.in ()]()*: top 100M*
+1. ![](https://www.google.com/s2/favicons?domain=) [Kotburger ()]()*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=https://lib.reviews) [LibReviews (https://lib.reviews)](https://lib.reviews)*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=https://www.liebe69.de) [Liebe69 (https://www.liebe69.de)](https://www.liebe69.de)*: top 100M, de*
 1. ![](https://www.google.com/s2/favicons?domain=https://lovemakeup.ru) [Lovemakeup (https://lovemakeup.ru)](https://lovemakeup.ru)*: top 100M, ru*
@@ -2599,38 +2642,38 @@ Rank data fetched from Alexa by domains.
 1. ![](https://www.google.com/s2/favicons?domain=https://www.hozpitality.com) [hozpitality (https://www.hozpitality.com)](https://www.hozpitality.com)*: top 100M*
 1. ![](https://www.google.com/s2/favicons?domain=https://kazanlashkigalab.com) [kazanlashkigalab.com (https://kazanlashkigalab.com)](https://kazanlashkigalab.com)*: top 100M, kz*
 
-The list was updated at (2022-02-27 01:43:04.619091 UTC)
+The list was updated at (2022-03-06 13:20:30.830064 UTC)
 ## Statistics
 
-Enabled/total sites: 2440/2595 = 94.03%
+Enabled/total sites: 2483/2638 = 94.12%
 
-Incomplete checks: 523/1853 = 28.22% (false positive risks)
+Incomplete checks: 523/1892 = 27.64% (false positive risks)
 
 Top 20 profile URLs:
 - (796)	`{urlMain}/index/8-0-{username} (uCoz)`
+- (229)	`/{username}`
 - (221)	`{urlMain}{urlSubpath}/members/?username={username} (XenForo)`
-- (221)	`/{username}`
-- (138)	`/user/{username}`
+- (144)	`/user/{username}`
 - (134)	`{urlMain}{urlSubpath}/member.php?username={username} (vBulletin)`
-- (96)	`/profile/{username}`
+- (101)	`/profile/{username}`
 - (87)	`{urlMain}/u/{username}/summary (Discourse)`
-- (74)	`/users/{username}`
+- (75)	`/users/{username}`
 - (44)	`{urlMain}{urlSubpath}/search.php?author={username} (phpBB/Search)`
 - (41)	`/members/?username={username}`
+- (40)	`/@{username}`
 - (39)	`SUBDOMAIN`
-- (36)	`/@{username}`
-- (28)	`/u/{username}`
+- (30)	`/u/{username}`
+- (27)	`/members/{username}`
 - (27)	`{urlMain}{urlSubpath}/memberlist.php?username={username} (phpBB)`
-- (25)	`/members/{username}`
 - (18)	`/forum/members/?username={username}`
 - (18)	`/forum/search.php?keywords=&terms=all&author={username}`
 - (17)	`/search.php?keywords=&terms=all&author={username}`
 - (16)	`/author/{username}`
-- (14)	`/profile.php?mode=viewprofile&u={username}`
+- (14)	`/people/{username}`
 
 Top 20 tags:
 - (271)	`forum`
-- (79)	`NO_TAGS` (non-standard)
+- (83)	`NO_TAGS` (non-standard)
 - (50)	`gaming`
 - (24)	`photo`
 - (24)	`coding`

utils/update_site_data.py

@@ -114,7 +114,7 @@ def get_readable_rank(r):
                 sys.stdout.flush()
                 index = index + 1
 
-        sites_full_list = [(s, s.alexa_rank) for s in sites_subset]
+        sites_full_list = [(s, int(s.alexa_rank)) for s in sites_subset]
 
         sites_full_list.sort(reverse=False, key=lambda x: x[1])