cartodb

3.10.2 (2015-05-20)

• Ongoing backend refactor and migration from Sequel to ActiveRecord.
• Frontend assets cleaning PR 3563.

Steps to avoid problems with submodules changes

# Before get last changes from master, let's remove the 
# common submodule
git submodule deinit app/assets/stylesheets/common
# Clean tmp sass folder, avoiding possible compass problems
rm -rf tmp/sass/*
git pull origin master
git submodule sync
git submodule update --init

Bugfixes:

• Create import view throws uncaught error on canceling selected a file (2nd time) #3379.

• New user account & profile management pages, inside CartoDB Editor.
• Fixed UNIX timestamps converted to a date column loses time #990
• Fixed Column wkb_geometry appears when importing #2107. Needs updating ogr2ogr2-static-bin package
• Added Hubspot for usage statistics #2575
• Updates cartodb.js to 3.12.11
• Fixes update table as statements from the editor #2620
• Fixes the showing of map previews in the delete items dialog #2639
• New organization pages done
• Hiding SaaS links in open source edition #2646
• Allows to remove overlays using the backspace key.
• Update favicon to retina #2686

Bugfixes:

• Fix layer refresh when the method of a density visualization changes #2673
• Fixes an error that preventing the load of WMS layers.
• Fixes an unncessary binding that made the dashboard reloading twice.
• Fix markdown from descriptions not rendered correctly in dashboard view #2572
• Fix new dashboard URLs creation #2662
• Redirect to list on delete table vis #2697
• Fix account settings order #2700
• Fix geocoding by Lon/Lat: refresh the table #2699
• Fix multiuser quota is not well calculated in multiuser dashboard #2722
• Fix new public pagination #2716
• Fix contrast for nav buttons #2696
• Fix top/bottom padding for delete dialog #2721
• Fix filters view's search component behavior #2708
• Fix bubble wizard legend not being updated on column change #2747

• New Features
  • Multiuser support
  • Added avatar_url to User model
  • Added custom avatars
  • Added Permission model and permission attribute for Visualizations
  • Activated Sequel extension connection_validator.
    This requires adding to database.yml a value for 'conn_validator_timeout',
    else code will default to 900 seconds
  • Several minor improvements
• Fixed bugs
  • Security fix regarding Typhoeus library
  • Several minor bugs
• Migration Type (see UPGRADE): Mandatory migration
  • As stated by the README, PostgreSQL now MUST be at least 9.3 to avoid search_path errors
  • Cartodb postgres extension update to 0.3.0
  • Also mandatory to run:
    • rake cartodb:db:create_default_vis_permissions
    • rake cartodb:db:populate_permission_entity_id

• Fixed bugs
  • Last used colors working properly in color-picker.
  • HTML template working properly for header infowindows.
  • Make import_id visible for any kind of import error.
  • Values from unknown column type are displaying correctly.
  • Custom title within SQL and CartoCSS editor fixed.
  • allow "rectangle" option for marker-type in torque layer
  • now enqueing sync tables who are in state syncing for more than 2 hours
    (caused by pushing code while syncing a table)
  • fixed torque wizard for google maps
  • fixed infinite loop in CDB_QueryStatements (again)
  • fixed problem executing long queries from the editor
  • By default, now not verifying SSL certificates for data imports (allow customer dev. environments with https)
  • Import CSV with invalid UTF-8 characters by replacing them (instead of skipping the whole row)
  • stop sending stats from public views after some time
  • Now installing and using Cartodb-postgres extension (current 0.2.0)
• New features
  • Tumblr-widget available in dashboard where a new post is published.
  • Added a log method for db_maintenance rakes
    (logs to log/rake_db_maintenance.log).
    For now used on load_functions.
  • Added avatar_url to User model
• Migration Type (see UPGRADE): Mandatory migration
  • Check also installtion steps for cartodb postgres extension

2.14.1 (2014-05-28)

• New features
  • Upgraded UPGRADE doc and required rakes to run
  • Added new aux method to do future code cleanups in rakes : execute_on_users_with_index
  • Added user_id to Visualization Model
  • Added specs for table model, checking the_geom conversions
  • Improve merge tables log info
  • Allows adding custom legends in Torque maps
  • SEO in public pages
• Fixed bugs
  • Converting the_geom causes drop that fails due to trigger (PR477)
  • Excel2CSV gem messes up with atypical UTF-8 characters
  • ogc_fid not being removed after import
  • Creating table from sql query actually creates two tables
  • Fixes a bug with the default values for the choropleth legends
• Migration Type (see UPGRADE): Mandatory migration
  • Also mandatory to run (in this order as fist one sets functions used by second one):
    • rake cartodb:db:reset_trigger_check_quota
    • rake cartodb:db:load_functions

2.14.0 (2014-05-20)

• New features
  • Adds markdown support for descriptions
  • New WMS proxy server
  • SQL based table CartoDBfication
  • New rake tasks
  • Migrate user quota on cartodb extension creation from unpackaged
  • Complain if script is sourced in psql, rather than via CREATE EXTENSION
• Fixed bugs
  • Bug fixing and stabilization
  • Improve error detection in viz.json action
  • Ruby code no longer loading import files in memory, but streaming them in chunks upon: uploading to server, uploading to AS3, downloading from AS3/server
  • lib/sql modifications:
    • Remove CDB_SearchPath.sql from the set of scripts loaded directly (#466)
    • Do not call CDB_Invalidate_Varnish() if not owned by a superuser
    • Refuse to create new extension if legacy code is present on database
    • Fix extension requires directive

• New features
  • Infowindows on Hover
  • SQL functions moved to a Git submodule
  • CDB_CheckQuota improved in preparations for SQL-Based table CartoDBfier
• Fixed bugs
  • Cluster wizard font sizes are scaling very cleanly
  • Big files imports/data syncs timeout or OOMs
  • Default avatar requests not using https
  • A transparent line appears within infowindow in last Chrome version
  • Add new accepted formats in Dropbox sync
  • Change error when importing a file and there is not enough quota left
  • When a custom tooltip is applied in a layer, if you reload the browser, it doesn't appear anymore
  • If you select fields with null values, it displays neither title nor value on the new tooltip (infowindow on hover)
  • User name is not appearing in that user profile (link in description)

• Improvements
  • Indent html in the legends html editor
  • Revamp geocoreference modal window
  • Include import ID in import error popup
  • Add POI option in the geocoder dialog
• Bugfixes
  • Applying a custom pattern image for polygons, it triggers the change event twice
  • Rename sequence when renaming a table
  • In the tags selector, order them alphabetically
  • Timeout should be lifted for Georeferencing
  • Bubble Legend doesn't refresh the labels when the field is changed
  • Disallow some html keywords in infowindow and legends editor
  • Incorrect message on table syncing
  • Make links on visualization decriptions linkable
  • Named maps wrapper should throw an exception on missing internal tiler config
  • Don't fetch the_geom and the_geom_webmercator when a sql query is applied
  • When trying to change table name and have a query applied, open a dialog / tipsy
  • Geocoding by zip fixes
  • After applying a wizard to a layer, and then changing a numeric property in the
    CartoCSS, it is not changed in the wizard panel.
  • When creating a new visualization, we should add some url_options by default
  • Can't create table from scratch
  • Pagination in public pages doesn't work correctly
  • No error shown in MapView UI when sql does not select "the_geom_webmercator"
  • JS in the login view is not being initialized
  • Maki icons with 24 pixels of height is being rendered weird
  • EXPLAIN an EXPLAIN ANALYZE does not work from the UI
  • Export fails on private tables
  • Vizualization specs do not honour configuration database name
  • Importing a big shapefile fails with no error message
  • when a filter is applied sometimes the generated sql is wrong
  • HTTPS problem when exporting tables in Firefox
  • Requests to the SQL API are always done using the port 80
  • When adding an X/Y/Z layer as basemap dont check for tile 0/0/0 as it might not
    always be there
  • Change error code style when an import fails

• Improvements
  • Add 'sync now' link on the sync tables
  • Create a default options modal window
  • When a layer is selected and the user clicks on the layer name, show a tipsy telling that double click allows to rename it
  • Add button for going to public page on the "SHARE" window (embed map)
  • Possibility to filter by different values in the same column [TABLE FILTERS]
  • Mock WMS call in tests
  • Take the new icons window a bit higher when opening
• Bugs
  • use maker-fill-opacity instead marker-opacity in wizards
  • WMS base layer not working with GeoServer w/ proper projection
  • Adding an empty description to a table prevents for changing it later
  • Close infowindow when other wizard is selected
  • Equal interval is actually doing another Quantile
  • polygon-opacity:undefined when adding a pattern-fill to a polygon
  • Add a link in the public view pointing to embed map page
  • Properly report long import timeouts messages
  • Sync Tables loses CartoCSS when sync
  • line-width: 0 render lines with width > 0 in torque
  • column options show "clear view" when you have no query applied
  • change filter in frontend to use new sql api params
  • Improve sync tables exception bubbling
  • improve compass compiling in development

• Improvements
  • Fix problem when the geocoding cache API is slow
  • [Geocoder] Do not use external APIs to geocode latitude/longitude
  • Geocoding window to allow IP Address geocode
  • New icon sets on the UI
  • Embeds in public page
• Bugs
  • Refactor column type change to date
  • Equal interval is actually doing another Quantile
  • Add success message on georeference
  • master branch tests stabilization after uuids migration
  • Give (more)/better info when georeferencing with admin regions fails
  • Failing sync tables from Dropbox Public folder
  • Create a default color for null values within cloropeths visualization
  • Unselecting all the fields in the filter widget produces an ugly query
  • When being a view mode warn that you cannot operate in contextual menus
  • tags are align-center instead of align left on the public tables list
  • Avoid each_char in CSV normalization but detect wrong multilines
  • When a geocode process fails, the background geocoder (the bar at the left bottom) is still visible
  • Fix error when creating organization users
  • Incorrect map count in map page
  • Retrieve more data in the geocoding response
  • Provide a default random name for url-based imports
  • "Map doesn't exist or private" for free user with public map
  • Change privacy button for dropdown doesn't work
  • Amazon S3 throws 403 on HEAD verb
  • Setup the backend to store the visualizations params
  • _setCustomVar for public pages

• New Features
  • Add Midnight commander basemap
  • oAuth-based Google Drive and Dropbox integration
• Bugs and improvements
  • When georeferencing by lon/lat columns, convert strings to number first
  • Missing fonts in account assets
  • Map views graph display error
  • Color picker bindings still persist after it is cleaned
  • Sql query editor no longer breaks if you add ''
  • Review last used colors functionality on color picker.
  • Proxima Nova and SEGOE UI fonts are not being loaded using IE9 in Windows 7
  • Typo on "No georeferenced data on your table" window
  • Fixed crash when user wants to delete a layer from a visualization
  • Public dashboard footer no longer gets rendered in private dashboard
  • Logged-in detection in public pages
  • "CartoDB" link points to your public profile page
  • Fix sublayer_options sharing in the public_dashboard
  • Error when creating public vizz
  • Fix line-height of the tags in the public dashboard

NOTE: This version introduces another kind of privacy setting: "Link-only".
Now visualizations and tables which are public are listed by default on user pages.
Due to this, you may want to turn all your Public tables and visualizations to "Link-only" state.
To do this, just run the following SQL query on your metadata database:

UPDATE visualizations SET privacy='link' WHERE privacy='public';
UPDATE user_tables SET privacy=2 WHERE privacy=1;

• New features
  • Public User Pages: now users have a public dashboard on their CartoDB homepage
    which will show all the public visualizations and tables on their account.
  • Add new "link-only" privacy status for tables.
• Improvements
  • New endpoint to extract user information
• Fixed bugs
  • Using CartoDB.js, if you create a layer from a viz.json url, and then try to
    hide it, its interaction still works
  • Fixes in session handling when multuple users are logged at the same time
  • Run a update to change all paid users public visualizations from public to link
  • Torque layer offsets when several layers in public page

• Improvements
  • Frontend code (JS) is now no longer compiled using the assets pipeline. You can
    use the asset_host setting on app_conflg.yml to point to assets on our own CDN
    or to your own ones if you compile them manually using Grunt.
    For more details, look at lib/build/UPGRADING.md.
  • Automate frontend unit tests

• Bugs Fixed
  • Public map is not loaded using https.
  • Public table fails on order by.
  • Clear view raises wrong sql query.
  • Ugly error on Table name change.
  • Increase map height in the public_map page.
  • Torque layer raises an exception in google maps.
  • Normal sync tables do not properly log errors.
  • All rows returned at once from queries written in the SQL pane.
  • In the layer selector, if you unselect all the layers, and then only activates one, the infowindow is neither appearing nor working.

• Improvements
  • Improved Cluster Wizard.
  • Changed behaviour in the asset manager dialog.
  • Alternative automatic geocoding from tab delimited uploads over X rows.
  • Enable mouse wheel when the map is in fullscreen mode.
• Bugs Fixed
  • Small fixes in the public map page.
  • Public pages map center does not correspond with share dialog.
  • Scrolling infowindows in the public_map page scrolls the whole map.
  • Fixed padding in the public table list.
  • Click over lock should open privacy window.
  • Importer: cannot guess content-type from http header.
  • Styles are wrongly set after renaming a freshly imported table.
  • Added a row of last colours used in the visualization (on the wizards) in the colorpicker.
  • Using a cartocss variable makes the UI to stop working. It does not apply new styles.
  • Table renaming "unlinks" tables and vis sometimes.
  • Creating a visualization from a table does not add the table.
  • When cluster wizard is applied and using a filter, a message of 'interaction is disabled' appears.
  • Small typo when free user tries to switch to private.
  • Using the new color picker in the CartoCSS editor, after choosing a default color, we should not lose the focus in the editor.
  • Table UI won't reload after successful geocoding.
  • Do not escape single quotes in category wizard.
  • Infowindow fields are renderer in reverse order.
  • Import files containing lat/lon with ',' instead of '.' break.
  • Infowindow content is not being loaded using https when embed is loaded with https.

2.11.0 (2014-03-10)

IMPORTANT NOTE

From this release, CartoDB uses UUIDs instead of IDs to reference to all objects on
the database, so that it is being able to work on distributed environments much
reliably.

Your database would need manual upgrade in order to use this CartoDB version.

We have created a script to help you migrate your database. Even this script has
been tested and used on production environments by us, we highly encourage
to make a FULL backup of your database before running it.
This backup should involve both PostgreSQL metadata and user data databases
and redis metadata database.

In order to run this migration you need to stop your application and make sure
that there is not any connection to your databases while you run the script.

After you run the migration script manually you will need to run the rails
migration task as usual.
This migration will detect that your database is already in the right state and will
continue normally (and won't work until you do so).

Notice that this migration is mandatory in order to use this CartoDB version
and any other future version. Also, versions starting with this one are
incompatible with the old database schema with integer based ids.

These are the steps you need to follow in order to run the manual script:

  $ cd <application_root>
  $ export RAILS_ENV=<rails_env>
  $ export DBNAME=<your_postgresql_database_name>
  $ export DBHOST=<your_postgresql_database_host>
  $ export DBUSER=<your_postgresql_database_user>
  $ export REDIS_HOST=<your_redis_host>
  $ bundle exec ruby ./script/migrate_to_uuid.rb schema
  $ bundle exec ruby ./script/migrate_to_uuid.rb meta
  $ bundle exec ruby ./script/migrate_to_uuid.rb data
  $ bundle exec ruby ./script/migrate_to_uuid.rb clean

Now, back to the features:

• New Features
  • All metadata storage is now UUID-based
  • Implement new public map page
  • Implement new georeference options
  • Implement new geocoder logic in the backend, allowing to geocode by regions
    using open data
• Bugs Fixed
  • Improvements of traces for Sync Tables
  • Fix errors when deleting user databases on distributed environemtns
  • Show in color-picker all the colors you are using in your visualization
    (colors from other layers and so on)
  • Make cartodb UI work without Google Maps JS
  • Fix error with geocoder row counts
  • Changed XYZ test preventing server issues
  • Changed color picker interaction
  • Prevent default actions from new share buttons
  • Fix several JS specs
  • Disable statsc collection in https from embed to avoid security problems
  • Adding a table to a public visualization changes the privacy of the vis
  • Full screen options are enabled by default for public visualizations
  • Empty the_geom from CSV no longer imports to "" instead of NULL
  • Trying to change a password no longer returns unauthorized
  • User destroy no longer fails when he has named maps
  • /api/v1/tables returns 404 when table does not exist
• Improvements
  • Integrate JavaScript error handling reporting
  • Add db migrations to alter the schemas to uuid
  • Activate fullscreen button on embeds by default
  • When adding a color, add a thumbnail close to the HEX value on the cartocss
    editor

• Improvements
  • Improved invalid WMS layers feedback.
  • Buttons for the Embeds
  • Added an alert so the user knows when a private map viz.json is used.
  • Allow CSVs with multiline inside for importing.
• Bugs Fixed
  • Legend number is null when apply filter.
  • Metatile with too many features is messing up some maps.
  • Problems importing a kml.
  • Problem with sequel and columns with same name in different schemas.
  • Changed embed to open password dialog when visualization needs password.
  • Infowindow data is cached when feature is edited.
  • SQL is being send in viz.json for torque layer with named maps.
  • 'searchControl' doesn't work using CartoDB.js and a viz.json.
  • Legends should be activated by default after applying a choropleth / category / intensity / etc... wizard.
  • named maps does not manage queries with !bbox!
  • Roo Excel import Ruby gem takes too long on big files.
  • If user types a non valid number within a number widget, a JS error appears.
  • viz.json includes wrong layer_index.
  • public map + pass protected vis is not returning named map in viz.json.
  • When discards adding a new point, a javascript exception appears.
  • Going to protected_embed_map directly throws 404.
  • OSM import via URL broken due to URL format change.
  • Private visualizations should be allowed when private tables are enabled.
  • Private map created with empty css.
  • Keep getting an error when setting new Torque CSS in dashboard.
  • Layer selector does not work in gmaps.
  • Fixed typo in api keys view.

• Improvements
  • Revamped privacy for visualizations.
  • Implement unified MAP API.
  • Named Maps Ruby API wrapper Unit/Integration tests.
  • Add Fullscreen button to iframe.
• Bugs Fixed
  • Set correct attributes service params to work with infowindows.
  • Upgraded message still present after downgrade.
  • It's impossible to move points when there's a torque layer.
  • Ordering by numeric DESC will show nulls at top.
  • viz.json includes infowindow template when there are no infowindow fields active.
  • The title of the fake share window inside of the publish modal is missing.
  • Infowindow shouldn't be enabled in Cluster wizard.
  • CSV importer failure due to missing stream.rewind.
  • Disable GDrive panel for importing new files.
  • When switching from normal layer to torque layers the normal layer is still shown.
  • Change resolution in torque layer does not work.

• Improvements
  • Improved color picker.
• Bugs Fixed
  • When deleting a user from the box, his database should be deleted before deleting his metadata.
  • Map turns blank at "Publish" time.
  • Revamp option for selecting a marker image / polygon pattern fill.
  • Wrong message shown in dashboard.
  • Undefined constants in certain importer flows.
  • When edit a polygon in leaflet move the map to [-180, 180]
  • Wizards don't show anything selecteed.
  • Autoselect last uploaded asset by default in the assets modal window.

• Improvements
  • Added geocodings bar to the submenu.
  • Use unique names on indexes and sequences.
• Bugs Fixed
  • Fixed encoding error on geocoder.
  • the_geom column is empty after loading a shapefile multipoint.
  • Fix error when having tables with same name on different schemas
  • XLSX file with multiline in row fields breaks importer.
  • Roo is not able to open certain XSLX.
  • Table name sanitizer failing when sanitized name already exists.
  • Fix error when changing user quotas.