сканирование книг в mysql базу не работает

2 months 1 week ago #1985 by vadimvolk
vadimvolk created the topic: сканирование книг в mysql базу не работает
Почему-то не добавляет книги в mysql базу. При запуске вэб интерфейса и сканера показывается:
WARNINGS:
?: (urls.W005) URL namespace 'web' isn't unique. You may not be able to reverse all URLs in this namespace

Сканер запускаю так:
python3 manage.py sopds_scanner scan

Через какое-то время процесс python3 пропадает из списка активных без сообщений об ошибке. Лог сканера

2017-11-15 08:54:53,162 INFO ***** Starting sopds-scan...
2017-11-15 08:54:53,170 INFO FB2SAX = True
2017-11-15 09:01:44,104 WARNING Flibusta.Net/f.usr-425051-428054.zip - Olga Vasilevna Migel_Zamena dlya chuvstvennogo monstra.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 09:01:51,014 WARNING Flibusta.Net/f.usr-425051-428054.zip - Yuliya Alekseevna Firsanova_Bozhestvennye golovolomki, Ili voyna za lyubov.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 09:10:06,759 WARNING Flibusta.Net/f.usr-220877-222968.zip - Charles_Portis_True_Grit.epub Book parse error, skipping... (Error: 'ValueError' object has no attribute 'message')
2017-11-15 09:10:09,895 WARNING Flibusta.Net/f.usr-220877-222968.zip - John_Gallaugher_Information_Systems_A_ManagerтАЩs_Guide_to_Harnessing_Technology.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 09:18:05,240 WARNING Flibusta.Net/f.fb2-386287-389890.zip - 386989.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (encoding specified in XML declaration is incorrect: line 1, column 31))
2017-11-15 09:18:05,250 WARNING Flibusta.Net/f.fb2-386287-389890.zip - 386990.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (encoding specified in XML declaration is incorrect: line 1, column 31))
2017-11-15 09:18:05,331 WARNING Flibusta.Net/f.fb2-386287-389890.zip - 386994.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (encoding specified in XML declaration is incorrect: line 1, column 31))
2017-11-15 09:26:46,884 WARNING Flibusta.Net/f.fb2-177718-183065.zip - 182116.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (encoding specified in XML declaration is incorrect: line 1, column 31))
2017-11-15 09:27:27,596 WARNING Flibusta.Net/f.usr-495619-497807.zip - Holistic_Beauty_from_the_Inside_Out__Your_Complete_Guide_to_Natural_Health,_Nutrition,_and_Skincare.epub Book parse error, skipping... (Error: ePub verification failed: broken zip archive)
2017-11-15 09:34:44,336 WARNING Flibusta.Net/fb2-119691-132107.zip - 120844.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (mismatched tag: line 3490, column 2))
2017-11-15 09:34:44,452 WARNING Flibusta.Net/fb2-119691-132107.zip - 120845.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (mismatched tag: line 1929, column 2))
2017-11-15 09:34:44,741 WARNING Flibusta.Net/fb2-119691-132107.zip - 120867.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (mismatched tag: line 2531, column 2))
2017-11-15 09:34:44,797 WARNING Flibusta.Net/fb2-119691-132107.zip - 120869.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (mismatched tag: line 1059, column 2))
2017-11-15 09:34:45,010 WARNING Flibusta.Net/fb2-119691-132107.zip - 120882.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (mismatched tag: line 3763, column 2))
2017-11-15 09:34:46,649 WARNING Flibusta.Net/fb2-119691-132107.zip - 121005.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (mismatched tag: line 3135, column 2))
2017-11-15 09:35:07,797 WARNING Flibusta.Net/fb2-119691-132107.zip - 122485.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (mismatched tag: line 132, column 2))
2017-11-15 09:35:29,064 WARNING Flibusta.Net/fb2-119691-132107.zip - 124269.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (encoding specified in XML declaration is incorrect: line 1, column 31))
2017-11-15 09:35:48,855 WARNING Flibusta.Net/fb2-119691-132107.zip - 126076.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (mismatched tag: line 12, column 276))
2017-11-15 09:35:52,379 WARNING Flibusta.Net/fb2-119691-132107.zip - 126390.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (mismatched tag: line 9, column 216))
2017-11-15 09:35:54,689 WARNING Flibusta.Net/fb2-119691-132107.zip - 126570.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (mismatched tag: line 21, column 130))
2017-11-15 09:35:55,526 WARNING Flibusta.Net/fb2-119691-132107.zip - 126620.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (mismatched tag: line 23, column 2))
2017-11-15 09:36:00,019 WARNING Flibusta.Net/fb2-119691-132107.zip - 129300.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (mismatched tag: line 11, column 294))
2017-11-15 09:36:00,051 WARNING Flibusta.Net/fb2-119691-132107.zip - 129304.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (mismatched tag: line 10, column 277))
2017-11-15 09:36:00,073 WARNING Flibusta.Net/fb2-119691-132107.zip - 129305.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (mismatched tag: line 20, column 190))
2017-11-15 09:36:02,515 WARNING Flibusta.Net/fb2-119691-132107.zip - 129556.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (mismatched tag: line 13, column 165))
2017-11-15 09:36:05,117 WARNING Flibusta.Net/fb2-119691-132107.zip - 129813.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (not well-formed (invalid token): line 14, column 1))
2017-11-15 09:37:55,738 WARNING Flibusta.Net/f.usr-242734-246562.zip - Anita_Diamant_The_Red_Tent.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 09:37:58,398 WARNING Flibusta.Net/f.usr-242734-246562.zip - Dzhon_Le_Karre_The_Tailor_of_Panama.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 09:37:58,410 WARNING Flibusta.Net/f.usr-242734-246562.zip - Dzhon_Mortimer_Rumpoles_Return.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 09:37:58,420 WARNING Flibusta.Net/f.usr-242734-246562.zip - Dzhon_Mortimer_Rumpole_of_the_Bailey.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 09:37:58,430 WARNING Flibusta.Net/f.usr-242734-246562.zip - Dzhon_Mortimer_The_Trials_of_Rumpole.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 09:37:59,643 WARNING Flibusta.Net/f.usr-242734-246562.zip - Giles_Foden_Turbulence.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 09:37:59,661 WARNING Flibusta.Net/f.usr-242734-246562.zip - Gyles_Brandreth_Oscar_Wilde_and_the_Candlelight_Murders.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 09:38:02,303 WARNING Flibusta.Net/f.usr-242734-246562.zip - Keyt_Atkinson_Human_Croquet.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 09:38:02,342 WARNING Flibusta.Net/f.usr-242734-246562.zip - Keyt_Atkinson_When_Will_There_Be_Good_News.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 09:38:02,358 WARNING Flibusta.Net/f.usr-242734-246562.zip - Kim_Edwards_The_Memory_Keepers_Daughter..epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 09:38:35,061 WARNING Flibusta.Net/f.usr-242734-246562.zip - Louise_Erdrich_The_Painted_Drum.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 09:38:35,260 WARNING Flibusta.Net/f.usr-242734-246562.zip - Mark_Heddon_Boom.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 09:38:37,386 WARNING Flibusta.Net/f.usr-242734-246562.zip - Piter_Meyl_A_Dogs_Life.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 09:38:40,280 WARNING Flibusta.Net/f.usr-242734-246562.zip - Tim_Pears_Wake_up.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 09:49:11,364 WARNING Flibusta.Net/f.usr-254651-258561.zip - Winifred_Watson_Miss_Pettigrew_Lives_for_a_Day.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 09:54:17,040 WARNING Flibusta.Net/f.usr-318555-322393.zip - Stig_Larsson_Os_Homens_Que_Nao_Amavam_as_Mulheres.epub Book parse error, skipping... (Error: ePub verification failed: broken zip archive)
2017-11-15 10:00:50,242 WARNING Flibusta.Net/fb2-074392-091839.zip - 91582.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (mismatched tag: line 15, column 2))
2017-11-15 10:13:32,282 WARNING Flibusta.Net/f.usr-294078-297652.zip - John_Biddulph_The_Pirates_of_Malabar_and_An_Englishwoman_in_India_Two_Hundred_Years_Ago.epub Book parse error, skipping... (Error: 'ValueError' object has no attribute 'message')
2017-11-15 10:13:39,317 WARNING Flibusta.Net/f.usr-294078-297652.zip - U._S._Nuclear_Weapons_The_Secret_History.epub Book parse error, skipping... (Error: 'ValueError' object has no attribute 'message')
2017-11-15 10:13:59,780 WARNING Flibusta.Net/f.usr-459344-462296.zip - Lev_Ifimovich__Michael_Booth__The_Almost_Nearly_Perfect_People.epub Book parse error, skipping... (Error: 'ValueError' object has no attribute 'message')
2017-11-15 10:25:18,705 WARNING Flibusta.Net/f.usr-325326-329045.zip - Dzh._R._Uord_Nachtjagd__Dark_Lover.epub Book parse error, skipping... (Error: 'ValueError' object has no attribute 'message')
2017-11-15 10:41:38,675 WARNING Flibusta.Net/f.usr-314958-318554.zip - Yasmine_Galenorn_Schwestern_des_Mondes_09_Vampirblut_.epub Book parse error, skipping... (Error: 'ValueError' object has no attribute 'message')
2017-11-15 10:51:02,720 WARNING Flibusta.Net/f.usr-246563-250364.zip - SVYaTYiE_DREVNEY_RUSI.epub Book parse error, skipping... (Error: 'ValueError' object has no attribute 'message')
2017-11-15 10:52:41,314 WARNING Flibusta.Net/f.usr-489360-492346.zip - An_Anthropologist_on_Mars__Seven_Paradoxical_Tales.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 10:53:23,572 WARNING Flibusta.Net/usr-158326-161827.zip - Artur_Konan-Doyl_The_Hound_of_the_Baskervilles.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 10:53:23,654 WARNING Flibusta.Net/usr-158326-161827.zip - Artur_Konan-Doyl_The_Memoirs_of_Sherlock_Holmes.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 10:53:23,737 WARNING Flibusta.Net/usr-158326-161827.zip - Artur_Konan-Doyl_The_Return_of_Sherlock_Holmes.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 10:53:33,553 WARNING Flibusta.Net/usr-158326-161827.zip - Piter_Brayant_Red_Alert.epub Book parse error, skipping... (Error: 'KeyError' object has no attribute 'message')
2017-11-15 10:54:40,056 WARNING Flibusta.Net/f.fb2-173909-177717.zip - 174393.fb2 Book parse error, skipping... (Error: fb2 verification failed: FB2sax parse error (encoding specified in XML declaration is incorrect: line 1, column 31))
2017-11-15 10:55:44,899 WARNING Flibusta.Net/f.usr-285623-290406.zip - Agata_Kristi_Taken_at_the_Flood.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 10:55:53,386 WARNING Flibusta.Net/f.usr-285623-290406.zip - Flenn_O_N039;Brayen_The_Third_Policeman.epub Book parse error, skipping... (Error: 'KeyError' object has no attribute 'message')
2017-11-15 10:56:34,857 WARNING Flibusta.Net/f.usr-365134-368728.zip - Nik Nayt_Nik Nayt - Illyuziya viny.epub Book parse error, skipping... (Error: 'ValueError' object has no attribute 'message')
2017-11-15 11:03:46,597 WARNING Flibusta.Net/f.usr-467682-471133.zip - The_Snow_Rose.epub Book parse error, skipping... (Error: ePub verification failed: broken zip archive)
2017-11-15 11:04:00,353 WARNING Flibusta.Net/f.usr-332168-335440.zip - Lois_Louri_Gathering_Blue.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 11:17:13,206 WARNING Flibusta.Net/f.usr-368729-372448.zip - Tatyana Aleksandrovna Alyushina_Risk egoisticheskogo svoystva (polnaya versiya).mobi Book parse error, skipping... (Error: 'utf-8' codec can't decode byte 0xd0 in position 31: unexpected end of data)
2017-11-15 11:23:11,070 WARNING Flibusta.Net/f.usr-497808-499888.zip - Bolsheviki__Dokumenty_po_istorii_bolshevizma_s_1903_po_1916_god_byvshego_Moskovskogo_Ohrannogo_Otdeleniya.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 11:23:22,011 WARNING Flibusta.Net/f.usr-497808-499888.zip - Haker,_2005_no_07.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 11:23:23,487 WARNING Flibusta.Net/f.usr-497808-499888.zip - Istoricheskiy_vestnik.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 11:23:26,435 WARNING Flibusta.Net/f.usr-497808-499888.zip - Letopisec,_soderzhashchiy_Rossiyskuyu_istoriyu_ot_6714_1206_leta_do_7042_1534_leta,_to_est_do_carstvovaniya_carya_Ioanna_Vasilevicha,_kotoryy_sluzhit_prodolzheniem_Nestorovu_letopiscu.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 11:23:30,646 WARNING Flibusta.Net/f.usr-497808-499888.zip - Nestor_Vasilevich_Kukolnik_Evelina_de_Valerol.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 11:23:30,733 WARNING Flibusta.Net/f.usr-497808-499888.zip - Nestor_Vasilevich_Kukolnik_Zhurnal___Ilyustraciya__.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 11:23:32,574 WARNING Flibusta.Net/f.usr-497808-499888.zip - Petrogradskiy_Sovet_rabochih_i_soldatskih_deputatov.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 11:23:33,512 WARNING Flibusta.Net/f.usr-497808-499888.zip - Pioner_1960_10.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 11:23:33,633 WARNING Flibusta.Net/f.usr-497808-499888.zip - Pioner_1972_8.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 11:23:33,713 WARNING Flibusta.Net/f.usr-497808-499888.zip - Pioner_1992_3_4.epub Book parse error, skipping... (Error: File is not a zip file)
2017-11-15 11:23:55,814 WARNING Flibusta.Net/f.usr-238404-242733.zip - Aleksandr_Makkoll_Smit_Akimbo_and_the_Snakes.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 11:23:55,822 WARNING Flibusta.Net/f.usr-238404-242733.zip - Aleksandr_Makkoll_Smit_The_Chocolate_Money_Mystery.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 11:23:55,834 WARNING Flibusta.Net/f.usr-238404-242733.zip - Aleksandr_Makkoll_Smit_The_Girl_Who_Married_a_Lion.epub Book parse error, skipping... (Error: ePub verification failed: 'mimetype' item content is incorrect)
2017-11-15 11:29:35,032 WARNING Flibusta.Net/f.usr-218015-220876.zip - Karen_Meytlend__VKMfQplCsI.epub Book parse error, skipping... (Error: File is not a zip file)

Please Войти or Create an account to join the conversation.

  • vadimvolk
  • vadimvolk's Avatar Topic Author
  • Offline
  • Новый участник
  • Новый участник
More
2 months 1 week ago #1986 by vadimvolk
vadimvolk replied the topic: сканирование книг в mysql базу не работает
В файле настройки мускуля, ОС и pip list. Если вставлять в текст сообщения пишет "You have too many links in your message, please decrease them!"

Спасибо за помощь и отличную программу!
Attachments:

Please Войти or Create an account to join the conversation.

  • vadimvolk
  • vadimvolk's Avatar Topic Author
  • Offline
  • Новый участник
  • Новый участник
More
2 months 6 days ago - 2 months 6 days ago #1988 by mitshel
mitshel replied the topic: сканирование книг в mysql базу не работает
Попробуйте сначала python3 manage.py sopds_scanner scan --verbose
это даст несколько расшсреный лог.
Last Edit: 2 months 6 days ago by mitshel.

Please Войти or Create an account to join the conversation.

  • mitshel
  • mitshel's Avatar
  • Offline
  • Администратор
  • Администратор
More
2 months 5 days ago #1989 by vadimvolk
vadimvolk replied the topic: сканирование книг в mysql базу не работает
не очень понятно почему, но с ключом --verbose все сработало как положено и книги добавились.

Please Войти or Create an account to join the conversation.

  • vadimvolk
  • vadimvolk's Avatar Topic Author
  • Offline
  • Новый участник
  • Новый участник
More
Time to create page: 0.245 seconds