udata

• Upgrade sifter to 0.5.3 #1548
• Upgrade jquery-validation to 1.17.0 and fixes some issues with client-side URL validation #1550
• Minor change on OEmbed cards to avoid theme to override the cards font-family #1549
• Improve cli unicode handling #1551
• Fix DCAT harvester mime type detection #1552
• Add the missing harvester URL in admin #1554
• Fix harvester preview/job layout #1553
• Fix some search unicode issues #1555
• Small fixes on OEmbed URL detection #1556
• Use nb_hits instead of views to count downloads #1560
• Prevent an XSS in TermFacet #1561
• Fix breadcrumb bar layout on empty search result #1562

• Remove territory claim banner #1521
• Expose an OEmbed API endpoint using the new cards #1525
• Small topic fixes #1529
• Fixes the search result vertical cut off #1530
• Prevent visually disabled pagination buttons from being clicked #1539
• Fixes "sort organization by name" not working #1537
• Non-admin users should not see the "publish as anyone" filter field on "publish as" screen #1538

• Fixes on upload: prevent double upload and bad chunks upload #1516
• Ensure OAuth2 tokens can be saved without refresh_token #1517

• Support request-body credential in OAuth2 (Fix a regression introduced in 1.3.0) #1511

• Fix some geozones/geoids bugs #1505
• Fix oauth scopes serialization in authorization template #1506
• Prevent error on site ressources metric #1507
• Fix some routing errors #1508
• Mongo connection is now lazy by default, preventing non fork-safe usage in celery as well as preventing commands not using the database to hit it #1509
• Fix udata version not exposed on Sentry #1510

Breaking changes

• Switch to flask-cli and drop flask-script. Deprecated commands have been removed. #1364
• Update card components to make them more consistent #1383 #1460
• udata is now protocol (http/https) agnostic. This is now fully the reverse-proxy responsibility (please ensure that you are using SSL only in production for security purpose). #1463
• Added more entrypoints and document them. There is no more automatically enabled plugin by installation. Plugins can now properly contribute translations. #1431

New features

• Soft breaks in markdown is rendered as line return as allowed by the commonmark specifications, client-side rendering follows the same security rules #1432
• Switch from OAuthlib/Flask-OUAhtlib to Authlib and support all grants type as well as token revocation #1434
• Chunked upload support (big files support) #1468
• Improve tasks/jobs queues routing #1487
• Add the udata schedule|unschedule|scheduled commands #1497

Bug fixes and minor changes

• Added Geopackage as default allowed file formats #1425
• Fix completion/suggestion unicode handling #1452
• Added a link to change password into the admin #1462
• Fix organization widget (embed) #1474
• High priority for sendmail tasks #1484
• Add security.send_confirmation template #1475

Internals

• Switch to pytest as testing tool and expose a udata pytest plugin #1400

• Translate Flask-Security email subjects #1413
• Fix organization admin pagination #1372
• Fix missing spinners on loading datatables #1401
• Fixes on the search facets #1410

• Markdown rendering is now the same between the back and the frontend. #604
• Make the dataset page reuses section and cards themable. #1378
• ValueErrors are not hidden anymore by the Bad Request error page, they are logged. #1382
• Spatial encoding fixes: prevent breaking unicode errors. #1381
• Ensure the multiple term search uses a AND operator #1384
• Facets encoding fixes: ensure lazy strings are propery encoded. #1388
• Markdown content is now easily themable (namespaced into a markdown class) #1389
• Fix discussions and community resources alignment on datasets and reuses pages #1390
• Fix discussions style on default theme #1393
• Ensure empty harvest jobs properly end #1395

• Add extras field in discussions #1360
• Fix datepicker #1370
• Fix error on forbidden scheme in is_url harvest filter #1376
• Fix an error on rendering present territory date #1377

• Bump chartjs version to 2.x #1352
• Sanitize mdstrip #1351

• Fix html2text dependency version #1362

• Fix wrongly timed notification on dataset creation with misformed tags #1332
• Fix topic creation #1333
• Add a udata worker status command to list pending tasks.[breaking] The udata worker command is replaced by udata worker start. #1324
• Prevent crawlers from indexing spammy datasets, reuses and organizations #1334 #1335
• Ensure Swagger.js properly set jQuery.ajax contentType parameter (and so data is properly serialized) #1126
• Allows theme to easily access the owner_avatar_url template filter #1336

• Fix misused hand cursor over the spatial coverage map in dataset admin #1296
• Fix broken post edit page #1295
• Display date of comments in dataset discussions #1283
• Prevent reindex command from failing on a specific object and log error instead. #1293
• Position the community resource link icon correctly #1298
• Add a sort option to query of list of posts in API #1301
• Import dropdown behavior from udata-gouvfr and fix hidden submenus on mobile #1297
• show message for emtpy dataset search #1044

• Fix flask_security celery tasks context #1249
• Fix dataset.quality handling when no format filled #1265
• Ignore celery tasks results except for tasks which require it and lower the default results expiration to 6 hours #1281
• Import community resource avatar style from udata-gouvfr #1288
• Terms are now handled from markdown and customizable with the SITE_TERMS_LOCATION setting. #1285
• Deeplink to resource #1289

• Check only the uncollapsed resources at first on dataset view #1246

• Fixes on the search index command #1245

• Introduce udata search index commmand to replace both deprecated udata search init and udata search reindex commands. They will be removed in udata 1.4. #1233
• Rollback oauthlib from 2.0.5 to 2.0.2, pending a permanent solution #1237
• Get cached linkchecker result before hitting API #1235
• Cleanup resources checksum [migration] #1239
• Show check results in resource modal #1242
• Cache avatar rendering #1243

New features and big improvements

• Expose harvester scheduling through the API and the admin interface #1123
• Added a udata info command for diagnostic purpose #1179
• Switch from static theme avatars/placeholders to identicons for readability (mostly on discussions) #1193
• Move croquemort features to a generic link checker architecture #1110
• CKAN and OpenDataSoft backends are now optionnal separate udata extensions #1213
• Better search autocomplete #1222
• Big post improvements (discussions support, navigation, fixes...) #1224

Breaking changes

• Upgrade to Celery 4.1.0. All celery parameters should be updated. (See Celery options documentation #1150
• Switch to Crowdin to manage translations #1171
• Switch to Flask-Security. Flask-Security-Fork should be uninstalled before installing the new requirements #958

Miscellaneous changes and fixes

• Display organization metrics in the organization page tab labels #1022
• Organization dashboard page has been merged into the main organization page #1023
• Fix an issue causing a loss of data input at the global search input level #1019
• Fixes a lot of encoding issues #1146
• Add .ttl and .n3 as supported file extensions #1183
• Improve logging for adhoc scripts #1184
• Improve URLs validation (support new tlds, unicode URLs...) #1182
• Properly serialize empty geometries for zones missing it and prevent leaflet crash on invalid bounds #1188
• Start validating some configuration parameters #1197
• Remove resources without title or url [migration] #1200
• Improve harvesting licenses detection #1203
• Added missing delete post and topic admin actions #1202
• Fix the scroll to a discussion sub-thread #1206
• Fix duplication in discussions [migration] #1209
• Display that a discussion has been closed #1216
• Explicit dataset search reuse facet context (only known reuses) #1219
• Optimize indexation a little bit #1215
• Fix some reversed temporal coverage [migration] #1214

• Display membership modal actions buttons for site administrators and on membership display. #1176
• Fix organization avatar in admin profile #1175

• Prevent a random territory from being displayed when query doesn't match #1124
• Display avatar when the community resource owner is an organization #1125
• Refactor the "publish as" screen to make it more obvious that an user is publishing under its own name #1122
• Make the "find your organization" screen cards clickable (send to the organization page) #1129
• Fix "Center the full picture" on user avatar upload #1130
• Hide issue modal forbidden actions #1128
• Ensure spatial coverage zones are resolved when submitted from the API or when querying oembed API. #1140
• Prevent user metrics computation when the object owner is an organization (and vice versa) #1152