Commit Graph

2833 Commits

Author SHA1 Message Date
evazion
1bfc0a7d8a pawoo: get status id from normalized url. 2017-06-19 17:09:57 -05:00
evazion
e91942dff3 pawoo: add source tests and docs. 2017-06-19 17:09:57 -05:00
evazion
77c78430db pawoo_api_client.rb: convert tabs to spaces. 2017-06-19 17:08:52 -05:00
Albert Yi
584b01457b Merge pull request #3172 from evazion/fix-twitter-tags
Fix #3171: Translate Twitter Hashtags to assist with tagging
2017-06-19 13:24:13 -07:00
Albert Yi
361ba4e9ea Merge pull request #3170 from evazion/fix-note-normalize-links
Convert absolute links in notes to relative links (fix #1911)
2017-06-19 13:23:39 -07:00
Albert Yi
586a3186fd Merge pull request #3167 from evazion/feat-dtextify-pixiv-artcomm
Convert Pixiv commentaries to DText (fix #2458)
2017-06-19 13:22:31 -07:00
Type-kun
faa2d99160 Fix #3174 2017-06-19 18:22:58 +05:00
evazion
128e655aef twitter: fetch hashtags for translated tags (fixes #3171). 2017-06-17 16:15:23 -05:00
evazion
8c7c2a06e5 notes: convert internal links to Danbooru to relative urls. 2017-06-17 11:57:32 -05:00
evazion
94e48aa6f3 pixiv: convert commentary to dtext.
Convert pixiv links to dtext in this manner:

* https://www.pixiv.net/member_illust.php?mode=medium&illust_id=1234
  => pixiv #1234 "»":[/posts?tags=pixiv:1234]

* https://www.pixiv.net/member.php?id=1234
  => "user/1234":[https://www.pixiv.net/member.php?id=1234] "»":[/artists?search[url_matches]=https://www.pixiv.net/member.php?id=1234]
2017-06-16 18:42:37 -05:00
evazion
c638ff2e9c pixiv: fix nil commentary fields to empty string. 2017-06-16 18:42:37 -05:00
Albert Yi
8b8b4fde71 Merge pull request #3160 from evazion/feat-note-sanitization
Improve note sanitization
2017-06-16 12:48:46 -07:00
evazion
5dd3151d5b twitter: convert commentary to dtext.
* Convert hashtags and mentions to dtext links.
* Replace http://t.co urls to the actual url.
* Strip the http://t.co url linking to the tweet itself.
2017-06-16 12:56:55 -05:00
evazion
9909ff20cd twitter: memoize api response. 2017-06-16 12:56:55 -05:00
evazion
91ed793120 notes: mark links as nofollow. 2017-06-15 22:58:22 -05:00
evazion
845b278b1e notes: make allowed css properties explicit. 2017-06-15 22:58:22 -05:00
evazion
9570bf026c notes: allow <rtc>, <sub>, <sup>, <hr>, <wbr> tags. 2017-06-15 22:58:22 -05:00
evazion
869ccad6ba notes: allow all elements to have style/title attributes. 2017-06-15 22:58:14 -05:00
evazion
990f173b3d notes: move sanitization from d_text.rb to note_sanitizer.rb. 2017-06-15 22:58:13 -05:00
Type-kun
bf6add5273 Add more support for negated existing metatags 2017-06-15 18:11:53 +05:00
r888888888
f27d065e1f fixes #3119 2017-06-14 16:30:19 -07:00
r888888888
6174d0eef2 normalize nijie popup urls (fixes #3153) 2017-06-14 12:26:13 -07:00
Albert Yi
f780b32012 Merge pull request #3145 from r888888888/flagger_metatag
Add "flagger:" and "appealer:" metatags (fixes #3142)
2017-06-14 11:02:08 -07:00
Type-kun
1375cc5307 Added privilege check for seeing flagger usernames
Also reworked all places dealing with flagger names to use said privilege
2017-06-14 20:43:25 +05:00
Albert Yi
ee28cf539f Merge pull request #3146 from evazion/fix-reltags-alias
Fix #1608: Show wiki page of alias consequent for Related Tags
2017-06-13 15:39:42 -07:00
evazion
c06ae5277e Fix #1608: Show wiki page of alias consequent for Related Tags
Make related tags apply aliases before fetching tags from the wiki page.
2017-06-12 19:52:19 -05:00
Type-kun
5d4592e0e0 Add "flagger:" and "appealer:" metatags (fixes #3142) 2017-06-13 00:15:49 +05:00
evazion
f3f55daea6 Fix #3138: Support DeviantArt login-only works. 2017-06-10 10:34:51 -05:00
evazion
82c7537270 deviantart: force commentary encoding to utf-8. 2017-06-09 13:19:24 -05:00
evazion
ccacfb40be deviantart: translate artist commentary from html to dtext. 2017-06-09 13:19:24 -05:00
Albert Yi
7fb0e561cc Merge pull request #3124 from evazion/fix-artstation-sources
Multiple ArtStation fixes
2017-06-08 14:11:21 -07:00
evazion
39bd141667 artstation: fix fetch source data for image urls.
Fixes 'Fetch source data' when uploading an image url and the referer
url is available:

* https://danbooru.donmai.us/uploads/new?url=https://cdna.artstation.com/p/assets/images/images/006/029/978/large/amama-l-z.jpg&ref=https://www.artstation.com/artwork/4BWW2
2017-06-07 10:20:18 -05:00
evazion
b1171306a1 artstation: include only images in image_urls. 2017-06-07 10:20:18 -05:00
evazion
215569fbe0 artstation: fix source to page url after download. 2017-06-07 10:20:17 -05:00
evazion
a68ff3c347 artstation: accept www.artstation.com/artwork/foo-bar-baz style urls. 2017-06-07 10:20:17 -05:00
evazion
fed23c0baa fetch source data: fix gallery warning for non-pixiv galleries. 2017-06-06 23:03:07 -05:00
evazion
047fb68f45 Fix #3117: Nicoseiga handler grabbing wrong commentary source
* `summary` is the wrong field. It's the list of comments left by users,
  not the artist's commentary.

* For some reason `doc.response.image.description` returns nil even
  though the description element exists. Switch to `Hash.from_xml` to
  avoid this.
2017-06-06 13:44:43 -05:00
r888888888
e16320a376 fix paths of large sized images on s3 backup 2017-06-05 13:07:51 -07:00
evazion
b3e533f3ff Add download rewrite for https://$artist.artstation.com/projects/$id. 2017-06-05 14:03:51 -05:00
evazion
666aaef69c Add source support for https://$artist.artstation.com/projects/$id. 2017-06-05 14:03:38 -05:00
r888888888
09ed1ea720 another bug fix for nico seiga artist url normalization 2017-05-31 15:50:40 -07:00
r888888888
69fd6e6ca1 fixes #3102 2017-05-31 10:58:47 -07:00
r888888888
216ca06fee fixes #3100 2017-05-30 15:38:01 -07:00
r888888888
3a49b3c54b include normalized artist url in artist json 2017-05-30 12:01:18 -07:00
Albert Yi
7a3431caaa Merge pull request #3097 from evazion/fix-mass-update
Mass updates: fix exception when moving saved searches.
2017-05-30 11:41:16 -07:00
Albert Yi
5b56596de1 Merge pull request #3092 from evazion/opt-reltags
Optimize related tags calculation
2017-05-30 11:12:24 -07:00
evazion
88d14b30ed mass updates: log modaction after update successfully completes. 2017-05-28 11:56:44 -05:00
evazion
c1a8800bf8 mass updates: fix exception when moving saved searches. 2017-05-28 11:55:05 -05:00
evazion
8f98e8e03c posts: redefine source column to be non-NULL (fixes #3090). 2017-05-26 13:54:17 -05:00
evazion
991d5cbf6d related tags: optimize calculate_from_sample.
calculate_from_sample is called when clicking the General / Artist /
Copyright / Characters buttons during tag editing. Currently it's slow
because it counts up the tags in ruby, and because it makes repeated
calls to memcache in the inner loop when filtering tags by category.

This changes it to do the counting and filtering entirely in SQL using a
GROUP BY tag / COUNT(*) aggregation. This is faster and makes larger
sample sizes more feasible.
2017-05-26 12:41:48 -05:00