evazion
|
3aa5cab2aa
|
sources: refactor normalize_for_source.
`normalize_for_source` was used to convert image URLs to page URLs when displaying sources
on the post show page. Move all the code for converting image URLs to page URLs from
`Sources::Strategies#normalize_for_source` to `Source::URL#page_url`.
Before we had to be very careful in source strategies not to make any network calls in
`normalize_for_source`, since it was used in the view for the post show page. Now all the
code for generating page URLs is isolated in Source::URL, which makes source strategies
simpler. It also makes it easier to check if a source is an image URL or page URL, and if
the image URL is convertible to a page URL, which will make autotagging bad_link or
bad_source feasible.
Finally, this fixes it to generate better page URLs in a handful of cases:
* https://www.artstation.com/artwork/qPVGP instead of https://anubis1982918.artstation.com/projects/qPVGP
* https://yande.re/post/show?md5=b4b1d11facd1700544554e4805d47bb6s instead of https://yande.re/post?tags=md5:b4b1d11facd1700544554e4805d47bb6
* http://gallery.minitokyo.net/view/365677 instead of http://gallery.minitokyo.net/download/365677
* https://valkyriecrusade.fandom.com/wiki/File:Crimson_Hatsune_H.png instead of https://valkyriecrusade.wikia.com/wiki/File:Crimson_Hatsune_H.png
* https://rule34.paheal.net/post/view/852405 instead of https://rule34.paheal.net/post/list/md5:854806addcd3b1246424e7cea49afe31/1
|
2022-03-23 01:34:04 -05:00 |
|
evazion
|
7394660ba9
|
posts: fix exception when post has source like 'https://www.twitter.com/username'.
`twitter.com` sources worked but `www.twitter.com` didn't.
Also match the URL by class instead of by site name to ensure we match
the expected class.
|
2022-03-20 21:08:05 -05:00 |
|
evazion
|
28971fe103
|
sources: factor out site_name method.
|
2022-03-11 23:20:53 -06:00 |
|
evazion
|
4701027f45
|
sources: remove unused methods from base strategy.
Remove unused `urls`, `parsed_urls`, and `domains` methods.
|
2022-03-10 23:11:00 -06:00 |
|
evazion
|
26f4cf1ebd
|
sources: factor out Source::URL::Skeb.
|
2022-02-25 02:06:57 -06:00 |
|
nonamethanks
|
33db1a2761
|
Skeb: fix several issues with the strategy
* Fix fetching of videos
* Fix fetching of original commentary
* Fix images being returned out of order in bookmarklet
|
2022-01-14 21:24:48 +01:00 |
|
evazion
|
a7dc05ce63
|
Enable frozen string literals.
Make all string literals immutable by default.
|
2021-12-14 21:33:27 -06:00 |
|
nonamethanks
|
a845477cba
|
Sources: fix artist_name not being caught in skeb and weibo
|
2021-09-14 11:32:24 +02:00 |
|
nonamethanks
|
606b311841
|
Fix skeb strategy
|
2021-08-15 02:16:56 -05:00 |
|
nonamethanks
|
1bc266a3db
|
Skeb: add support for multi-image posts and fix tests
|
2021-05-16 12:50:39 +02:00 |
|
nonamethanks
|
e95731d58f
|
Skeb: fix broken strategy
|
2021-05-04 21:18:12 +02:00 |
|
nonamethanks
|
dc97f4483b
|
Add skeb support
|
2021-03-04 21:53:27 +01:00 |
|
