evazion
|
3aa5cab2aa
|
sources: refactor normalize_for_source.
`normalize_for_source` was used to convert image URLs to page URLs when displaying sources
on the post show page. Move all the code for converting image URLs to page URLs from
`Sources::Strategies#normalize_for_source` to `Source::URL#page_url`.
Before we had to be very careful in source strategies not to make any network calls in
`normalize_for_source`, since it was used in the view for the post show page. Now all the
code for generating page URLs is isolated in Source::URL, which makes source strategies
simpler. It also makes it easier to check if a source is an image URL or page URL, and if
the image URL is convertible to a page URL, which will make autotagging bad_link or
bad_source feasible.
Finally, this fixes it to generate better page URLs in a handful of cases:
* https://www.artstation.com/artwork/qPVGP instead of https://anubis1982918.artstation.com/projects/qPVGP
* https://yande.re/post/show?md5=b4b1d11facd1700544554e4805d47bb6s instead of https://yande.re/post?tags=md5:b4b1d11facd1700544554e4805d47bb6
* http://gallery.minitokyo.net/view/365677 instead of http://gallery.minitokyo.net/download/365677
* https://valkyriecrusade.fandom.com/wiki/File:Crimson_Hatsune_H.png instead of https://valkyriecrusade.wikia.com/wiki/File:Crimson_Hatsune_H.png
* https://rule34.paheal.net/post/view/852405 instead of https://rule34.paheal.net/post/list/md5:854806addcd3b1246424e7cea49afe31/1
|
2022-03-23 01:34:04 -05:00 |
|
evazion
|
7394660ba9
|
posts: fix exception when post has source like 'https://www.twitter.com/username'.
`twitter.com` sources worked but `www.twitter.com` didn't.
Also match the URL by class instead of by site name to ensure we match
the expected class.
|
2022-03-20 21:08:05 -05:00 |
|
evazion
|
28971fe103
|
sources: factor out site_name method.
|
2022-03-11 23:20:53 -06:00 |
|
evazion
|
f062f2d145
|
sources: factor out Source::URL::Newgrounds.
Also fix it so that the image URL is set as the source for Newgrounds
posts, not the page URL. It's possible to generate the page URL from the
image URL (except for images after the first in multi-image posts).
* Page: https://www.newgrounds.com/art/view/natthelich/weaver
* Image: https://art.ngfiles.com/images/1520000/1520217_natthelich_weaver.jpg?f1606365031
|
2022-02-25 23:04:03 -06:00 |
|
evazion
|
a7dc05ce63
|
Enable frozen string literals.
Make all string literals immutable by default.
|
2021-12-14 21:33:27 -06:00 |
|
evazion
|
160b099445
|
sources: use http client from base strategy.
|
2020-08-17 15:30:01 -05:00 |
|
evazion
|
85f58bf2f6
|
newgrounds: fix style nitpicks.
|
2020-06-24 00:25:45 -05:00 |
|
nonamethanks
|
7a41ee9c34
|
Add NewGrounds support
|
2020-06-18 03:22:30 +02:00 |
|
