Fix for #129 along with many dependency version updates, especially rclone.

We are going to limit the number of open connection for sqlite to exactly 1 to not run into deadlock conditions. For this to work all flows had to be verified that they are not opening another connection if one is already open.

A transaction is passed down to all method which want to talk to the database.

This has unintended performance boost (for very high logs) since opening and closing db connections has some performance impact

Make the repository go get/go install compatible

• update rclone dependency
• remove redirection for one of the internal dependency

Added

• "Subject" (sub) in the issued JWT tokens (signin action)
• Columns in join table
• Allow fetching items based on join table column values (key: value filters)
• Index on foreign key columns
• Features in aggregate endpoint
  • Support "filter" clause
  • Support "having" clause
• Embed Commit information in the binaries
• Added cache at various places resulting in higher throughput
• "profile" as run time mode to dump heap and cpu metrics to a (configurable) directory
• Logs can be redirected to a file with configurable filenames (${HOSTNAME} and ${PID} variable available for file path)
  • Configurable auto log rotation and auto deletion of old log files

Removed

• Avatar link (email gravtar) from JWT token
• Recline model endpoint
• x86 builds from ci, please build manually or open a issue if you need them

• Hook actions to pre/post data update/create/delete
• Dadadash embedded to release artifacts (bug fix in ci script which was preventing that)
• YAML file format support for importing data
• Usergroup name is unique column (breaking change)

v0.9.5

• YJS compitable CRDT endpoint for live collaboration
• Websocket endpoint capabilities updates (filtered subscriptions, user created topics, user broadcast message)
• Streams to data views using filters
• Sql builder rewrite with goqu, mssql database now supported
• Tested build on raspberry pi 4 with arm 7 build
• Benchmarked with wrk on 16 GB machine -* 4k POST requests/seconds, 3k PUT requests/second*
• Exchange events execute actions, add pre and post hooks with row (being inserted) modification capabilities
• More tests

Lots of stability and performance improvements since the last release. Dashboard has been moved out to its own reposiotry.

The binaries have the dashboard embedded inside them.

A lot of changes in the dashboard

• Document editor
• Spreadsheet editor
• File manager
• Calendar with drag and drop events

Some notable changes in daptin:

• Cache object permissions locally, improved performance
• Accept and parse Database URL in env variables for connection
• Use golang cipher suite for IMAPS and SMTPS

Open dashboard at http://localhost:6336

The new dashboard is now in master.

• Minimum go version required to 1.13
• Various detail updates in the openapi v3 spec
  • Tested client generation from the openapi.yaml generated by daptin
• New cloudstore actions available to be hooked
  • List files
  • Get file contents
  • Delete file
  • Create file or folder
• Fix FTP path issue on windows
• Updated rclone dependency

Documentation

• Added comments on documentation with disqus
• Added documentation pages for new dashboard

• IP based rate limit for requests (Configurable)
• IP based concurrent connections limit number (Configurable)
• Table data can have translations enabled and automatically served based on "Accept-Language" Header
• 2FA login is now available, TOTP based, generate QR code using action is added for easier user registration
• Added basic spam score for emails received on SMTP
• Mail outgoing mails to be stored in DB for retries (WIP)
• Update rclone dependency version
• Expose subsites as FTP (apart from http/https) (authorization available)
• Improve restart logic, no real shutdown involved now
• Asset columns can be any binary file (and not just images as earlier)
• Basic daptin config editor included in dashboard
• "not contains" query should be true on null columns
• handle "undefined" in Accept-Language #83
• subsite hostname mapping is comma separated hostnames
• rand() ordering works for mysql ( random() will not work for postgres since it require order by column to appear in select )
• can sort by rand() or random()
• guests can query stats if execute permission allowed for guests

daptin-darwin-10.6-amd64:     Mach-O 64-bit executable x86_64
daptin-linux-386:             ELF 32-bit LSB executable, Intel 80386, version 1 (SYSV), dynamically linked, interpreter /lib/ld-, for GNU/Linux 2.6.32, BuildID[sha1]=2db3e41dc3d2f3efe2f523c29ebb60d55c212cbc, not stripped
daptin-linux-amd64:           ELF 64-bit LSB executable, x86-64, version 1 (SYSV), dynamically linked, interpreter /lib64/l, for GNU/Linux 2.6.32, BuildID[sha1]=fa1be3610f6231d038f09629a6afce275d6bf008, not stripped
daptin-linux-arm-5:           ELF 32-bit LSB executable, ARM, EABI5 version 1 (SYSV), dynamically linked, interpreter /lib/ld-, for GNU/Linux 3.2.0, BuildID[sha1]=8db9fe39db9beb89633a24e4e296d5128963a107, not stripped
daptin-linux-arm-6:           ELF 32-bit LSB executable, ARM, EABI5 version 1 (SYSV), dynamically linked, interpreter /lib/ld-, for GNU/Linux 3.2.0, BuildID[sha1]=223d745891767ab1c889a041f95d8eec519624d0, not stripped
daptin-linux-arm-7:           ELF 32-bit LSB executable, ARM, EABI5 version 1 (SYSV), dynamically linked, interpreter /lib/ld-, for GNU/Linux 3.2.0, BuildID[sha1]=478ffaec52e18da90aa22a8a1be45a842d3bcb6a, not stripped
daptin-linux-mips:            ELF 32-bit MSB executable, MIPS, MIPS32 rel2 version 1 (SYSV), dynamically linked, interpreter /lib/ld., for GNU/Linux 3.2.0, BuildID[sha1]=acedef088c41b9bb9ae2a322fb2885f296dd80a7, not stripped
daptin-linux-mips64:          ELF 64-bit MSB executable, MIPS, MIPS64 rel2 version 1 (SYSV), dynamically linked, interpreter /lib64/l, BuildID[sha1]=6f3b44b5d96e0e097daa7a061182d83899983580, for GNU/Linux 3.2.0, not stripped
daptin-linux-mips64le:        ELF 64-bit LSB executable, MIPS, MIPS64 rel2 version 1 (SYSV), dynamically linked, interpreter /lib64/l, BuildID[sha1]=95e200c9f025d958876fa248d187129094026285, for GNU/Linux 3.2.0, not stripped
daptin-linux-mipsle:          ELF 32-bit LSB executable, MIPS, MIPS32 version 1 (SYSV), dynamically linked, interpreter /lib/ld., for GNU/Linux 3.2.0, BuildID[sha1]=74704fbf9560cca774c66d133ceba93bc14cdaae, not stripped
daptin-windows-4.0-386.exe:   PE32 executable (console) Intel 80386, for MS Windows
daptin-windows-4.0-amd64.exe: PE32+ executable (console) x86-64, for MS Windows

a865d2e18dd26f86e220ff40518d4801  daptin-darwin-10.6-amd64
e48820116cdc755778e203ee9f4244a4  daptin-linux-386
30f53d6fd6e52b1bd7c876faae6c19b9  daptin-linux-amd64
6d6f0276c4fe8fe7cf211d16e7165d87  daptin-linux-arm-5
d6acd169406c1062466f455bfa0aeaca  daptin-linux-arm-6
7ae6dc6f80ccef6675486fef63b92686  daptin-linux-arm-7
4d9acb7d7b3fc37952e6a7c52fdf2982  daptin-linux-mips
fa1b746235f1df16d48382aa23cf784e  daptin-linux-mips64
dbe63036f77fba2341c3048af1e73009  daptin-linux-mips64le
54a2604174fd9309f762115ddb95b9d9  daptin-linux-mipsle
40d3ad24c51dc867653f6c838f5eb7d9  daptin-windows-4.0-386.exe
b277fe7819d4682a59eea698ab7551d4  daptin-windows-4.0-amd64.exe

New release after a long time so a lot many new features.

• Column with markdown support
• POC for IMAP server
• POC for mail server (deliver mails to daptin)
• OTP based registration and login supported (SMS api to be enabled to use this)
• Move creation of tables inside a transaction
• Columns as assets with support for image/audio/video direct fetch
• Image filters and processing inbuilt over asset columns
• PUT/POST/DELETE and ACTION APIs now available in graphql endpoint
• OpenAPI spec generation for tables and actions
• Permission bit revamped
• Support for pagination with "after" id
• New endpoint /user_account/mine to fetch self
• Support filtering in streams
• POC Mega Integrations (import Openapi spec to integrate external APIs)
• Improved test coverage (up to 35%)

Documentation yet to be updated around most of the new features. Let me know if you would like to help.

daptin-darwin-amd64:          Mach-O 64-bit executable x86_64
daptin-linux-386:             ELF 32-bit LSB executable, Intel 80386, version 1 (GNU/Linux), statically linked, for GNU/Linux 2.6.32, BuildID[sha1]=8de12ea3948155f54a8b0667ce72a552a417024e, not stripped
daptin-linux-amd64:           ELF 64-bit LSB executable, x86-64, version 1 (GNU/Linux), statically linked, for GNU/Linux 2.6.32, BuildID[sha1]=ca780384937f90c3d6a38781f6c1be0c6d33635d, not stripped
daptin-linux-arm-5:           ELF 32-bit LSB executable, ARM, EABI5 version 1 (SYSV), statically linked, for GNU/Linux 3.2.0, BuildID[sha1]=bbe80e93a291133ee102117bfe038a997e933798, not stripped
daptin-linux-arm-6:           ELF 32-bit LSB executable, ARM, EABI5 version 1 (SYSV), statically linked, for GNU/Linux 3.2.0, BuildID[sha1]=79f0fd19675792819b879ade8911ee70fefc82b9, not stripped
daptin-linux-arm-7:           ELF 32-bit LSB executable, ARM, EABI5 version 1 (GNU/Linux), statically linked, for GNU/Linux 3.2.0, BuildID[sha1]=ad152930286e48d021420ced64804c4d968e2a6a, not stripped
daptin-linux-arm64:           ELF 64-bit LSB executable, ARM aarch64, version 1 (SYSV), statically linked, for GNU/Linux 3.7.0, BuildID[sha1]=9efae1f4034245831d90c9830aa7b61a194d3fc4, not stripped
daptin-linux-mips:            ELF 32-bit MSB executable, MIPS, MIPS32 rel2 version 1 (SYSV), statically linked, for GNU/Linux 3.2.0, BuildID[sha1]=cd89f0f9f01f370df50e7195a5e426408a930e9a, not stripped
daptin-linux-mips64:          ELF 64-bit MSB executable, MIPS, MIPS64 rel2 version 1 (SYSV), statically linked, BuildID[sha1]=eac8cbbe75cf006edd2e8b100218dc31a959e19e, for GNU/Linux 3.2.0, not stripped
daptin-linux-mips64le:        ELF 64-bit LSB executable, MIPS, MIPS64 rel2 version 1 (SYSV), statically linked, BuildID[sha1]=622f39480e10dd4b48a83a50478f96cc1ec1bb49, for GNU/Linux 3.2.0, not stripped
daptin-linux-mipsle:          ELF 32-bit LSB executable, MIPS, MIPS32 version 1 (SYSV), statically linked, for GNU/Linux 3.2.0, BuildID[sha1]=5919fb616816a530f287fc91d976f2d93a220387, not stripped
daptin-windows-4.0-386.exe:   PE32 executable (console) Intel 80386, for MS Windows
daptin-windows-4.0-amd64.exe: PE32+ executable (console) x86-64, for MS Windows

ed24eb1ec223777ca7ba5f7de8de4435  daptin-darwin-amd64
c43189a537abbfb37cc7b23661cab060  daptin-linux-386
201ad69abb6dde1027020f65b492e214  daptin-linux-amd64
888605f452c9fc1bb4b884d10684e037  daptin-linux-arm-5
81ea5322f0bd34e02eb866440252d9be  daptin-linux-arm-6
5a821da9138e10ad85a525c12812bd2b  daptin-linux-arm-7
43edc14f395d049a67a68d9d61d309bd  daptin-linux-arm64
4e7b9d5a4c5e56ff84569ddc46bf4e8a  daptin-linux-mips
abcd09aa876f6bd1e793c753623483c2  daptin-linux-mips64
1b3272825dc22223631868a129088d33  daptin-linux-mips64le
8960b03f302ab12f945d0d0740a4f502  daptin-linux-mipsle
7798926b6d4e032f11aec9a9da395bc1  daptin-windows-4.0-386.exe
e0c9de3f5680b4555427284fe5da8f92  daptin-windows-4.0-amd64.exe

• New column type: markdown
• Update lots of dependence
• Pull request from @yaskhan
• Mail server can receive mails and store in database as gzipped blobs
• Multi tenant mail server configurable from interface
• New config for enable/disable graphql endpoint
• Fork thoas/stats and fix bug, use new release
• Can set daptin schema folder using env variable

daptin-darwin-10.6-386:       Mach-O executable i386
daptin-darwin-10.6-amd64:     Mach-O 64-bit executable x86_64
daptin-linux-386:             ELF 32-bit LSB executable, Intel 80386, version 1 (GNU/Linux), statically linked, for GNU/Linux 2.6.32, BuildID[sha1]=e2d6f95947e1db2c12da9d2e110e654fddec9709, not stripped
daptin-linux-amd64:           ELF 64-bit LSB executable, x86-64, version 1 (GNU/Linux), statically linked, for GNU/Linux 2.6.32, BuildID[sha1]=ea0bf8d584ab68932cea7bb47f6455d2cc37f93d, not stripped
daptin-linux-arm-5:           ELF 32-bit LSB executable, ARM, EABI5 version 1 (SYSV), statically linked, for GNU/Linux 3.2.0, BuildID[sha1]=65076a198ed7ec1d70b0742844b8c5bb712d314a, not stripped
daptin-linux-arm-6:           ELF 32-bit LSB executable, ARM, EABI5 version 1 (SYSV), statically linked, for GNU/Linux 3.2.0, BuildID[sha1]=a6280bb072731d1a33b42244b1e152f560b00aed, not stripped
daptin-linux-arm-7:           ELF 32-bit LSB executable, ARM, EABI5 version 1 (GNU/Linux), statically linked, for GNU/Linux 3.2.0, BuildID[sha1]=7348d4e53802edd2c34ce1a050f36c54691cd20a, not stripped
daptin-linux-arm64:           ELF 64-bit LSB executable, ARM aarch64, version 1 (SYSV), statically linked, for GNU/Linux 3.7.0, BuildID[sha1]=c6887eaa36ea8120cf433f46b46a1d381cd01291, not stripped
daptin-linux-mips:            ELF 32-bit MSB executable, MIPS, MIPS32 rel2 version 1 (SYSV), statically linked, for GNU/Linux 3.2.0, BuildID[sha1]=7631bccb58d80365d202d32943c5b27e4d9b74e3, not stripped
daptin-linux-mips64:          ELF 64-bit MSB executable, MIPS, MIPS64 rel2 version 1 (SYSV), statically linked, BuildID[sha1]=09bb618349b6214961f8576a3a28656aa75d88b9, for GNU/Linux 3.2.0, not stripped
daptin-linux-mips64le:        ELF 64-bit LSB executable, MIPS, MIPS64 rel2 version 1 (SYSV), statically linked, BuildID[sha1]=c9285547e2552057fbad9394388192b605064a08, for GNU/Linux 3.2.0, not stripped
daptin-linux-mipsle:          ELF 32-bit LSB executable, MIPS, MIPS32 version 1 (SYSV), statically linked, for GNU/Linux 3.2.0, BuildID[sha1]=9b0a2fc7be7a6b8d2899798729447969b6e7d2d1, not stripped
daptin-windows-6.0-386.exe:   PE32 executable (console) Intel 80386, for MS Windows
daptin-windows-6.0-amd64.exe: PE32+ executable (console) x86-64, for MS Windows

• Handle images/assets as entity fields
• set user owner for the oauth token after new oauth flow
• update readme
• update build command for travis
• update glide dependencies
• update vulnerable npm dependencies
• update rclone version
• new reserved word "lead" in mysql 8
• add "enable" column to sub site

• Refresh oauth token now available as action
• Check JWT token issuer for authentication
• New Action "Create Response" to create custom action response
• Rename "user" to "user_account", user is reserved word in postgres
• Rename aggregate column projections for postgres

83 commits since last release.

• Built with Go 1.9.3
• Password less login for social auth
• Inbuilt cron service/task scheduler to schedule repeating tasks (export report or sync with external services)
• More to latest icons for the dashboard
• Expose the endpoints /stats/.., /api/.. on sub-sites
• New logo
• Latest changes from dependent upstream projects (rclone)
• schedule sub-sites sync for sites at every 10 minutes
• Caching objects for n+1 for improved performances on large queries
• Advance query and filter parameters for in the /api and /graphql endpoints
• Add "export as csv" action which can be executed on any table
• Test oauth flow with more providers

Docker image at daptin/daptin

• More documentation
• Improved RAML specs
• API's under /api now available on subsites
• Improvements in grid views, try out different views
• Improve code coverage under tests from 4% to 15%
• Automated docker image builds using travis for bleeding edge under tag daptin:travis
• Update npm dependencies
• Improved and more precise filter support in GET APS's now available

• Automatic entity and column genrator based on CSV/XLS
• Improved column detection for XLS and CSV uploads
• Allow CSV uploads for data upload and entity creation
• Update fontawesome to version 5
• Add a new fancy check box form control, looks better
• Improve the date/time identifier with more format types
• Allow errors to go to the dashboard if action fails
• Optional Basic Authentication on sub sites
• Check for updated to column structures from json schema uploads
• Network request action is a lot more capable
• Allow JSON and url-form encoded post on actions
• Allow actions to skip the CRUD middleware layer
• Refactor the base resources handler
• Add persistence to the oauth2 profile token exchange action
• Allow actions to be conditionally executed
• Added couple of utility function
• Update JQuery version to 3.0.0
• Extend JWT token expiry time to 3 days
• Allow a set of groups to be assigned to every new entity
• Use the permission column in the usergroup table as the deciding permission value for auth
• Assets folder
• Cross build
• Permission over sub sites
• Updated version of various dependencies (notably rclone)

• Update jquery version to 3.0.0
• Extend JWT token expiry time to 3 days
• Allow a set of groups to be assigned to every new entity
• Remove some logs
• Use the permission column in the usergroup table as the deciding permission value for auth
• Assets folder
• Cross build
• Permission over sub sites
• Update npm package list
• Update build scripts for cross build
• Add automated cross compilation build script
• Base data for initial setup: marketplace
• Accept dashboard source code folder from arguments for heroku
• Update Heroku Procfile
• Show dashbaord on "dashboard." subdomain
• API endpoint on subdomain
• Update dependency for satori/uuid
• Migrate to new signature of satori/uuid.NewV4

Changelog

• Table Audit history can be optionally enabled for entities
• No foreign key index to be created in audit tables.
• DB name mapping for subsite structure
• File uploads and image uploads handling
• Show uploaded images on single instance view
• Images work like relations
• Image uploads to be stored in cloud store
• Image upload metadata stored in entity columns
• Can be multiple files
• Handle file upload on ui using relations
• Allow multiple type of editors for json/text in entities.
• Image field is a new field (not just a file)
• Upload images
• Cloud Storage is a foreign key away
• Uploads go to cloud storage
• Store image reference in the table
• Show file chooser for images
• Firefox sidebar icon unaligned fix
• Stats api client for JS
• Add general over view of system on dashbaord
• Stats endpoint provides: projections, aggregations, group by, filters and joins
• Update generate random data action for testing
• Change query builder limit for count query, pagination is improved
• Use http.Request.Context everywhere
• Stats api is: /stats/:tableName?query
• Add pagination for child lists
• Allow bulk data import from xls and csv on system start
• Expose aggregate/stats api for entities

Automated with @goreleaser
Built with go version go1.9 linux/amd64

Changelog

• Export data in JSON format
• Import data from JSON
• Add static files in final single executable for convenience
• Quick heroku deployment supported
• File upload field - multiple file type filter support
• Smaller Docker images for daptin
• Better handling for timestamp/date/time fields
• Basic support for Websockets [Complete support coming soon]
• Quick deployement files for kubernetes and docker-compose

Automated with @goreleaser
Built with go version go1.9 linux/amd64