GitLab

Revert "[#6] Race condition when resource URL is changed" because notify_after_commit doesnt work for some reason!

This reverts commit 5be1637d.

[#6] Race condition when resource URL is changed

Fixes #6
Not sure why the previous commit was lost.

Add option to switch off HTTPS verifying

"update-test" command added

* IPipe messages now no longer have the ckan_ini_filepath (misnamed) in
  the messages - this info can be got in other ways - see ckanext-qa.

Config was not being read by tasks.py

ETag checking

Fixing resource_group for ckan2.3+. Using same convention in all places

Only download files that have changed

Use else in template instead of two ifs

Convert report template to Jinja2

Changed the migrations_* dictionaries to be ordered so there is more
control over the ordering of model changes.

Adds a new paster command (migrate) that will update the archival table
if there have been any changes.  These changes are stored in the code
and checks are made against the current state of the database before the
SQL is run.

Some servers provide an etag which is a unique identifier for the
content being served (not always a hash).  This adds two new column to
the archival, an etag and a last-modified field.  If the etag is
available in the archival, and we get the same etag from the request,
then we will not download the file.  The last-modified field is saved
for sanity, it isn't yet used with If-Modified-Since in the request.

This requires a migration:

    alter table archival add column etag character varying;
    alter table archival add column last-modified character varying;

Notification of package updates is only done if at least 1 resource was
downloaded, to avoid unnecessarily running QA and Packagezip.