jaculabilis/danbooru
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
10,888 Commits 1 Branch 0 Tags
51a4daef47be87ddfbefbfb8eeaedbc6bfdb74a1
Commit Graph

512 Commits

Author SHA1 Message Date
evazion
a7dc05ce63 Enable frozen string literals. 
Make all string literals immutable by default.
 2021-12-14 21:33:27 -06:00
evazion
c94fdef3b2 foundation: fix fetching artist commentary. 
The markup for the description changed from a <div> to a <h2>.
 2021-12-08 03:01:54 -06:00
nonamethanks
41f9fde2e0 Fix foundation urls not working with iqdb 2021-11-15 10:10:49 +01:00
nonamethanks
49e232f2ae Foundation: add support for unconventional account names 2021-11-09 13:35:52 +01:00
nonamethanks
6c9b49c194 Foundation: add support for videos 2021-11-05 09:43:49 +01:00
nonamethanks
060223c9e2 Add Plurk support 2021-11-01 16:21:27 +01:00
evazion
5177a28f2c Merge pull request #4910 from nonamethanks/feat-foundation 
Add Foundation support
 2021-11-01 05:07:44 -05:00
nonamethanks
043f2fb124 Add Foundation support 2021-11-01 01:39:56 +01:00
evazion
9ff4d94382 Merge pull request #4909 from nonamethanks/add-lofter-theme 
Lofter: Add support for additional theme
 2021-10-31 05:13:04 -05:00
nonamethanks
5946544f71 Lofter: Add support for additional theme 2021-10-30 17:22:45 +02:00
evazion
bc506ed1b8 uploads: refactor to simplify ugoira-handling and replacements: 
* Make it so replacing a post doesn't generate a dummy upload as a side effect.
* Make it so you can't replace a post with itself (the post should be regenerated instead).
* Refactor uploads and replacements to save the ugoira frame data when
  the MediaAsset is created, not when the post is created. This way it's
  possible to view the ugoira before the post is created.
* Make `download_file!` in the Pixiv source strategy return a MediaFile
  with the ugoira frame data already attached to it, instead of returning it
  in the `data` field then passing it around separately in the `context`
  field of the upload.
 2021-10-18 05:18:46 -05:00
nonamethanks
45313c56a6 Lofter: fix tag extraction 2021-10-04 14:21:07 +02:00
evazion
738be825ff twitter: include artist name in source URLs on post pages. 
Show Twitter sources on post pages like this:

    https://twitter.com/BOW999/status/1261877313349640194

and not like this:

    https://twitter.com/i/web/status/1261877313349640194

We originally removed the artist name because the link would be broken
when the artist changed their name. This is no longer the case.
 2021-09-27 11:07:25 -05:00
evazion
34de3b4d18 Merge pull request #4879 from nonamethanks/fix-artist-name 
Sources: fix artist_name not being caught in skeb and weibo
 2021-09-14 05:39:06 -05:00
nonamethanks
a845477cba Sources: fix artist_name not being caught in skeb and weibo 2021-09-14 11:32:24 +02:00
nonamethanks
9a6a6e52ea Lofter: raise timeout for file download 2021-09-10 13:10:29 +02:00
evazion
38c9559fe8 nokogiri: switch to the nokogumbo-based html5 parser. 
https://github.com/sparklemotion/nokogiri/blob/main/CHANGELOG.md#1120--2021-08-02
 2021-08-30 21:21:27 -05:00
evazion
bb7f24d279 Add HTTP proxy support. 
Add support for using a proxy for HTTP requests. Only used for external
requests, such as downloading files or talking to source sites such as
Pixiv or Twitter, not for internal requests, such as talking to IQDB or
Reportbooru.
 2021-08-28 04:53:33 -05:00
nonamethanks
f60fce614b Fix lofter strategy due to changes in their image urls 2021-08-15 02:16:57 -05:00
nonamethanks
bb4bdefc23 Lofter: add support for another theme 2021-08-15 02:16:56 -05:00
nonamethanks
606b311841 Fix skeb strategy 2021-08-15 02:16:56 -05:00
evazion
07e23204b6 rubocop: fix various Rubocop warnings. 2021-06-17 04:17:53 -05:00
evazion
4003ddd788 Merge pull request #4808 from nonamethanks/fix-weibo 
Weibo: fix new lengthier image urls breaking the batch bookmarklet
 2021-06-02 15:17:54 -05:00
nonamethanks
ac4b4a151c Weibo: fix new lengthier image urls breaking the batch bookmarklet 2021-05-31 00:36:53 +02:00
nonamethanks
1234d93292 Nijie: get correct image when using bookmarklet 2021-05-25 12:20:39 +02:00
nonamethanks
ac071b147f Lofter: fix strategy for additional type of html theme 2021-05-23 18:05:16 +02:00
nonamethanks
bc4fd16c2c Add Lofter support 2021-05-19 16:40:33 +02:00
evazion
12eacbe76f Merge pull request #4800 from nonamethanks/fix-skeb 
Skeb: add support for multi-image posts and fix tests
 2021-05-17 12:16:21 -05:00
nonamethanks
1bc266a3db Skeb: add support for multi-image posts and fix tests 2021-05-16 12:50:39 +02:00
evazion
ba5a2dcd79 Merge pull request #4794 from nonamethanks/fix-skeb 
Skeb: fix broken strategy
 2021-05-05 05:08:52 -05:00
nonamethanks
e95731d58f Skeb: fix broken strategy 2021-05-04 21:18:12 +02:00
nonamethanks
cb6196c259 Nicoseiga: auto-add spoiler tags to commentary 2021-04-06 14:08:49 +02:00
evazion
b8f7c3795c Merge pull request #4767 from nonamethanks/pixiv-other-names 
Pixiv: don't add auto-generated usernames to the other names field
 2021-03-18 21:29:21 -05:00
nonamethanks
073f63cfa7 Pixiv: don't add auto-generated usernames to the other names field 2021-03-16 02:44:49 +01:00
nonamethanks
a123bf0ee8 Mastodon: fix strategy not working for direct or dead links 2021-03-09 22:35:36 +01:00
evazion
0249c290fd skeb: remove skeb from site_name in base strategy. 
Fixup a mistake with the way the merge conflict was resolved in 9dd903d21.
 2021-03-08 03:56:44 -06:00
evazion
9dd903d212 Merge branch 'master' into skeb 2021-03-08 03:43:15 -06:00
evazion
66af4986c6 Merge pull request #4754 from nonamethanks/lazymap 
Optimize Sources::Strategies.find()
 2021-03-08 03:40:28 -06:00
evazion
64440757c1 Merge pull request #4737 from nonamethanks/fix-mastodon-page-url 
Sources: get correct mastodon page url
 2021-03-08 01:49:56 -06:00
evazion
224d4932bf Merge pull request #4745 from nonamethanks/twitter-common-regexes 
Twitter: update common hashtag regexes
 2021-03-08 01:49:30 -06:00
evazion
e17cefe3ab Merge pull request #4753 from nonamethanks/fix-baraag-regex 
Baraag: fix image regex
 2021-03-08 01:49:15 -06:00
evazion
1716cc5bf9 artists: add more artist url icons. 2021-03-08 01:30:02 -06:00
evazion
869a99d9a3 nijie: clear session cookie if it's expired (#4665). 
If we detect that the session cookie has expired (by the presence of the
`#login_illust` element on the page), then clear the cached session
cookie. The current source fetch will still fail, but the next fetch
will try to login again and hopefully succeed.
 2021-03-08 01:30:02 -06:00
evazion
5e4865701c nijie: reduce login cookie cache duration to 60 minutes (#4665). 2021-03-08 01:30:02 -06:00
nonamethanks
a4ae07416a Optimize Sources::Strategies.find() 
Use lazy.map instead of map, so that we do not run every single
strategy's match method for every source
 2021-03-07 18:20:10 +01:00
nonamethanks
4118a3f3c9 Baraag: fix image regex 
Fixes a bug for Baraag.net that caused the batch bookmarklet to always pick the first picture in multi-image posts.
 2021-03-06 08:50:08 +01:00
nonamethanks
dc97f4483b Add skeb support 2021-03-04 21:53:27 +01:00
nonamethanks
e75489aa94 Twitter: update common hashtag regexes 2021-03-02 17:05:47 +01:00
nonamethanks
ba826ff6fa Sources: get correct mastodon page url 2021-02-26 19:45:01 +01:00
evazion
7b60a476e5 sources: add artist profile links to fetch source data box. 
Add site icons linking to all the artist's sites in the fetch source
data box.

Some artist entries have a large number of URLs. Various heuristics are
applied to try to present the most useful URLs first. Dead URLs and
redundant URLs (Pixiv stacc and Twitter intent URLs) are filtered out.
Remaining URLs are sorted first by site (to put sites like Pixiv and
Twitter first), then by URL (to break ties when an artist has multiple
accounts on the same site).

Some sites have shitty hard-to-read icons. It can't be helped. The icons
are the official favicons of each site.
 2021-02-26 01:24:30 -06:00