danbooru

jaculabilis/danbooru

Fork 0

Commit Graph

Author	SHA1	Message	Date
evazion	d2147eca80	tumblr: fix exception when fetching data for video urls. Fix an exception when trying to fetch source data for URLs like https://va.media.tumblr.com/tumblr_pgohk0TjhS1u7mrsl.mp4. For these URLs it's not possible to use the trick where we try to open the URL as a HTML page and scrape the post id from the HTML. Instead we get the raw video if we try to to this.	2022-09-05 16:15:47 -05:00
evazion	23b8350320	sources: add image_url?, page_url?, and profile_url? methods. Add methods to Source::URL for determining whether a URL is an image URL, a page URL, or a profile URL. Also add more source URL tests and fix various URL parsing bugs.	2022-05-01 21:01:36 -05:00
evazion	d9d3c1dfe4	sources: rename Sources::Strategies to Source::Extractor. Rename Sources::Strategies to Source::Extractor. A Source::Extractor represents a thing that extracts information from a given URL.	2022-03-24 03:49:44 -05:00

Author

SHA1

Message

Date

evazion

d2147eca80

tumblr: fix exception when fetching data for video urls.

Fix an exception when trying to fetch source data for URLs like
https://va.media.tumblr.com/tumblr_pgohk0TjhS1u7mrsl.mp4.

For these URLs it's not possible to use the trick where we try to open
the URL as a HTML page and scrape the post id from the HTML. Instead we
get the raw video if we try to to this.

2022-09-05 16:15:47 -05:00

evazion

23b8350320

sources: add image_url?, page_url?, and profile_url? methods.

Add methods to Source::URL for determining whether a URL is an image
URL, a page URL, or a profile URL.

Also add more source URL tests and fix various URL parsing bugs.

2022-05-01 21:01:36 -05:00

evazion

d9d3c1dfe4

sources: rename Sources::Strategies to Source::Extractor.

Rename Sources::Strategies to Source::Extractor. A Source::Extractor
represents a thing that extracts information from a given URL.

2022-03-24 03:49:44 -05:00

3 Commits