jaculabilis/danbooru
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
6,808 Commits 1 Branch 0 Tags
8de20d2b36eb6961167a84ff2bde4eae08ab3f48
Commit Graph

1283 Commits

Author SHA1 Message Date
evazion
8de20d2b36 Iqdb::Download.find_similar: raise on iqdb errors. 
* Raise an error on iqdb errors instead of returning no matches.
* Include the iqdb api response in the error response.
 2018-04-07 18:03:10 -05:00
evazion
b88a66dd30 Iqdb::Download.find_similar: simplify error handling. 
Raise errors immediately to avoid deeply nested if-else statements.
 2018-04-07 18:03:10 -05:00
evazion
d8142a6c21 iqdb_queries_controller.rb: simplify show / check actions. 
* Combine create_by_post + create_by_url. Rename to find_similar.
* Move iqdb enabled check to find_similar.
 2018-04-07 18:03:01 -05:00
Albert Yi
fc344e589d potential fix for #3604 2018-04-06 16:14:01 -07:00
evazion
a432980f85 Fix "wrong number of arguments (given 3, expected 2)" in Post#file_url. 2018-04-05 15:33:47 -05:00
Albert Yi
7d745ac93f Merge pull request #3598 from evazion/fix-3597 
Possible fix for #3597: Poor performance since last deploy
 2018-04-05 13:11:21 -07:00
Albert Yi
bf23a976e3 fix bug with async tagger check 2018-04-05 12:51:29 -07:00
evazion
084fcd91ed Only generate tagged filenames for URLs on post show pages (#3597). 
Don't generate tagged filenames for urls in the data attributes on
thumbnails, or in the /posts.json api.
 2018-04-05 14:20:37 -05:00
Albert Yi
b219992b7d add async processing for top tagger 2018-04-03 16:00:36 -07:00
evazion
04ecca6a06 Fix #3591: DeviantArt commentaries: strip embedded image/text thumbs. 2018-03-31 11:27:14 -05:00
evazion
80219a0ccf commentaries: replace <img> tags with dtext links (#3586) 
Replace <img> tags with dtext links, unless the <img> tag is already
inside an <a> tag.

Also strip Unicode spaces from DeviantArt commentaries.
 2018-03-30 21:42:51 -05:00
evazion
b185efbb5f tumblr commentaries: include asker's name in ask posts (#3586). 2018-03-30 21:42:51 -05:00
evazion
fd055a894b DanbooruImageResizer: workaround libvips-8.4 incompatibility. 2018-03-29 21:41:22 -05:00
Albert Yi
fa9442209e fix typo in storagemanager/s3 2018-03-28 17:23:07 -07:00
Albert Yi
18dd47c557 Merge branch 'master' of github.com:r888888888/danbooru 2018-03-28 17:19:35 -07:00
Albert Yi
929b2fa896 move default base url to method to deal with deployment issues 2018-03-28 17:19:21 -07:00
evazion
be0c2cfcfa posts: fix incorrect large_file_url for animated_gifs. 
For animated_gif posts, large_file_url was returning
"/data/sample-$md5.jpg" instead of "/data/$md5.gif".
 2018-03-28 19:17:15 -05:00
evazion
dc9b7e5bda Fix #3582: Switch from ImageMagick to libvips 2018-03-28 17:15:57 -05:00
evazion
f0bf1bc66e posts: use storage manager to backup files. 
* Perform backups synchronously inside `distribute_files` instead of
  asynchronously in `queue_backup`. Asynchronous backups assumed that
  files are stored on the local filesystem, which isn't true in general.

* Remove obsolete backup service classes.
 2018-03-20 19:49:06 -05:00
evazion
c76463f34d uploads: use storage manager to distribute files. 
Refactors the upload process to pass around temp files, rather than
passing around file paths and directly writing output to the local
filesystem. This way we can pass the storage manager the preview /
sample / original temp files, so it can deal with storage itself.

* Change Download::File#download! to return a temp file.

* Change DanbooruImageResizer and PixivUgoiraConverter to accept/return
  temp files instead of file paths.

* Change Upload#generate_resizes to return temp files for previews and samples.

* Change Upload#generate_resizes to generate ugoira .webm samples
  synchronously instead of asynchronously.
 2018-03-20 19:49:06 -05:00
evazion
60dcfbfbdd uploads: autotag animated_gif/png during upload. 
Move animated_gif / animated_png autotagging to take place during
uploading, instead of during tag editing. We can't generally assume the
file will be present on the local filesystem after uploading.
 2018-03-20 19:49:06 -05:00
evazion
b0c7d9c185 Add storage managers (local, sftp, s3, hybrid). 2018-03-20 19:49:06 -05:00
evazion
8a012d4c91 Remove unused mobile mode code (#3206). 
Mobile mode was removed in 31e36cf.
 2018-03-20 02:29:06 -05:00
r888888888
3657cacd17 * post keeper is calculated synchronously 
* add fallback mechanism in case archive service is not up
* pass along most recently added tags to any keeper calculation
 2018-03-08 16:00:44 -08:00
r888888888
0c5dcbbf68 Revert "Revert "implement post keepers"" 
This reverts commit b9fcfe0442.
 2018-03-06 18:04:31 -08:00
Albert Yi
159d807026 Merge pull request #3568 from evazion/fix-3552 
Fix #3552: Upload filesize limits can be bypassed
 2018-02-28 10:44:50 -08:00
evazion
5ad06a4034 Fix #3552: Upload filesize limits can be bypassed. 
* Change `http_get_streaming` to write the output file directly,
  instead of taking a callback.

* Track the filesize as the download progresses and abort when it
  exceeds the limit.

* Don't save the Content-Type (it's not used anywhere).
 2018-02-27 18:22:34 -06:00
evazion
9b89f0f54c Fix #3518: Don't prune mod actions. 2018-02-27 18:15:53 -06:00
Albert Yi
7d5ad1bcc4 Merge pull request #3563 from evazion/fix-3528 
Fix #3528: Add method to prevent image-hosting CloudFlare sites from altering the image
 2018-02-26 17:40:46 -08:00
evazion
2b8767d7f4 BulkUpdateRequest#approve!: don't swallow exceptions. 
Rescue `AliasAndImplicationImporter::Error` instead of `Exception`.
 2018-02-24 14:37:02 -06:00
evazion
c9eee7e4d4 Fix #3528: Prevent CloudFlare from altering images. 2018-02-24 13:42:00 -06:00
evazion
e48b75c261 downloads: rewrite url in download!, not http_get_streaming. 
Refactor Downloads::File#http_get_streaming to just download the given
url, not rewrite it.

Don't clobber @source or @data in `#size` either.
 2018-02-24 11:23:27 -06:00
evazion
3fefb73e90 Fix #3561: Tumblr: support answer posts. 2018-02-24 10:31:59 -06:00
r888888888
689b5690bf fixes #3560 2018-02-22 11:15:42 -08:00
Albert Yi
d8340f83db Revert "Fix #3528: Add method to prevent image-hosting CloudFlare sites from altering the image" 2018-02-21 17:20:13 -08:00
evazion
263fd0eef1 Fix #3528: Prevent CloudFlare from altering images. 2018-02-17 11:43:27 -06:00
evazion
1eff41a6f9 downloads: rewrite url in download!, not http_get_streaming. 
Refactor Downloads::File#http_get_streaming to just download the given
url, not rewrite it.

Don't clobber @source or @data in `#size` either.
 2018-02-17 11:11:50 -06:00
Albert Yi
b9fcfe0442 Revert "implement post keepers" 2018-02-07 12:28:56 -08:00
r888888888
da2864e233 change keeper name to tagger 2018-02-01 17:07:30 -08:00
r888888888
32cc508edb hide uploader information on posts/show page, add keeper information 2018-02-01 14:38:03 -08:00
Albert Yi
47bd812811 Merge pull request #3525 from BrokenEagle/fix-index-default-order 
Fix index default order
 2018-01-29 13:11:24 -08:00
BrokenEagle
d829ab3a00 Move all order logic to models 
- Have a default order for each model
-- The overall default is ID DESC
- Allow for custom orderings
-- When comma-separated IDs are used
 2018-01-29 11:42:53 -08:00
evazion
f8a5620768 Partial fix for #3514: Handle https://twitter.com/i/web/status/:id URL. 2018-01-23 23:07:21 -06:00
evazion
57c4d2a54f related tag calculator: fix unstable sorting of related tags. 
Fix this test failure:

    1) Failure:
    RelatedTagCalculatorTest#test_: A related tag calculator should convert a hash into string format.
    [test/unit/related_tag_calculator_test.rb:65]:
    Expected: "aaa 3 bbb 3 ccc 2 ddd 1"
      Actual: "bbb 3 aaa 3 ccc 2 ddd 1"

The related tag string didn't use a stable sort. Sort first by tag
count, then by tag name.
 2018-01-20 14:33:36 -06:00
evazion
2deefcc090 Fix exception when viewing /favorite_groups while logged out. 
Also fixes a test failure in the favgroups controller tests.
 2018-01-20 13:47:41 -06:00
Albert Yi
dfd343f70e Merge pull request #3496 from BrokenEagle/feat-mod-action-event-ids 
Add categories to mod actions
 2018-01-15 11:09:38 -08:00
BrokenEagle
3c45273694 Add category for mod actions 2018-01-13 20:55:52 -08:00
r888888888
af6ab74f8d support dedicated image servers 2018-01-03 13:32:50 -08:00
evazion
f710710cbb PostSets::Post#hide_from_crawler?: hide all metatag searches from crawlers. 2017-12-31 12:27:05 -06:00
evazion
f9ffa2b47a Fix #3484: /posts: don't show wiki tab for metatags. 2017-12-31 12:25:17 -06:00