Django 1.10 release notes - UNDER DEVELOPMENT

Welcome to Django 1.10!

These release notes cover the new features, as well as some backwards incompatible changes you’ll want to be aware of when upgrading from Django 1.9 or older versions. We’ve dropped some features that have reached the end of their deprecation cycle, and we’ve begun the deprecation process for some features.

Python compatibility

Like Django 1.9, Django 1.10 requires Python 2.7, 3.4, or 3.5. We highly recommend and only officially support the latest release of each series.

What’s new in Django 1.10

...

Minor features

django.contrib.admin

  • For sites running on a subpath, the default URL for the "View site" link at the top of each admin page will now point to request.META['SCRIPT_NAME'] if set, instead of /.
  • The success message that appears after adding or editing an object now contains a link to the object’s change form.
  • All inline JavaScript is removed so you can enable the Content-Security-Policy HTTP header if you wish.
  • The new InlineModelAdmin.classes attribute allows specifying classes on inline fieldsets. Inlines with a collapse class will be initially collapsed and their header will have a small “show” link.
  • If a user doesn’t have the add permission, the object-tools block on a model’s changelist will now be rendered (without the add button, of course). This makes it easier to add custom tools in this case.
  • The LogEntry model now stores change messages in a JSON structure so that the message can be dynamically translated using the current active language. A new LogEntry.get_change_message() method is now the preferred way of retrieving the change message.
  • Selected objects for fields in ModelAdmin.raw_id_fields now have a link to object’s change form.
  • Added “No date” and “Has date” choices for DateFieldListFilter if the field is nullable.

django.contrib.auth

  • Added support for the Argon2 password hash. It’s recommended over PBKDF2, however, it’s not the default as it requires a third-party library.
  • The default iteration count for the PBKDF2 password hasher has been increased by 25%. This backwards compatible change will not affect users who have subclassed django.contrib.auth.hashers.PBKDF2PasswordHasher to change the default value.
  • The logout() view sends “no-cache” headers to prevent an issue where Safari caches redirects and prevents a user from being able to log out.
  • Added the optional backend argument to login() to allow using it without credentials.
  • The new LOGOUT_REDIRECT_URL setting controls the redirect of the logout() view, if the view doesn’t get a next_page argument.
  • The new redirect_authenticated_user parameter for the login() view allows redirecting authenticated users visiting the login page.

django.contrib.gis

django.contrib.postgres

  • For convenience, HStoreField now casts its keys and values to strings.

django.contrib.sessions

  • The clearsessions management command now removes file-based sessions.

django.contrib.sites

django.contrib.staticfiles

  • The static template tag now uses django.contrib.staticfiles if it’s in INSTALLED_APPS. This is especially useful for third-party apps which can now always use {% load static %} (instead of {% load staticfiles %} or {% load static from staticfiles %}) and not worry about whether or not the staticfiles app is installed.

Cache

  • The file-based cache backend now uses the highest pickling protocol.

CSRF

  • The default CSRF_FAILURE_VIEW, views.csrf.csrf_failure() now accepts an optional template_name parameter, defaulting to '403_csrf.html', to control the template used to render the page.

Database backends

  • Temporal data subtraction was unified on all backends.
  • If the database supports it, backends can set DatabaseFeatures.can_return_ids_from_bulk_insert=True and implement DatabaseOperations.fetch_returned_insert_ids() to set primary keys on objects created using QuerySet.bulk_create().
  • Added keyword arguments to the as_sql() methods of various expressions (Func, When, Case, and OrderBy) to allow database backends to customize them without mutating self, which isn’t safe when using different database backends. See the arg_joiner and **extra_context parameters of Func.as_sql() for an example.

Email

  • ...

File Storage

File Uploads

  • ...

Forms

Generic Views

  • The View class can now be imported from django.views.

Internationalization

  • The i18n_patterns() helper function can now be used in a root URLConf specified using request.urlconf.
  • By setting the new prefix_default_language parameter for i18n_patterns() to False, you can allow accessing the default language without a URL prefix.
  • set_language() now returns a 204 status code (No Content) for AJAX requests when there is no next parameter in POST or GET.

Management Commands

  • call_command() now returns the value returned from the command.handle() method.
  • The new check --fail-level option allows specifying the message level that will cause the command to exit with a non-zero status.
  • The new makemigrations --check option makes the command exit with a non-zero status when model changes without migrations are detected.
  • makemigrations now displays the path to the migration files that it generates.
  • The shell --interface option now accepts python to force use of the “plain” Python interpreter.
  • The new shell --command option lets you run a command as Django and exit, instead of opening the interactive shell.
  • Added a warning to dumpdata if a proxy model is specified (which results in no output) without its concrete parent.
  • The new BaseCommand.requires_migrations_checks attribute may be set to True if you want your command to print a warning, like runserver does, if the set of migrations on disk don’t match the migrations in the database.
  • To assist with testing, call_command() now accepts a command object as the first argument.
  • The shell command supports tab completion on systems using libedit, e.g. Mac OSX.
  • The inspectdb command lets you choose what tables should be inspected by specifying their names as arguments.

Migrations

  • Added support for serialization of enum.Enum objects.
  • Added the elidable argument to the RunSQL and RunPython operations to allow them to be removed when squashing migrations.
  • Added support for non-atomic migrations by setting the atomic attribute on a Migration.

Models

  • Reverse foreign keys from proxy models are now propagated to their concrete class. The reverse relation attached by a ForeignKey pointing to a proxy model is now accessible as a descriptor on the proxied model class and may be referenced in queryset filtering.
  • The new Field.rel_db_type() method returns the database column data type for fields such as ForeignKey and OneToOneField that point to another field.
  • The arity class attribute is added to Func. This attribute can be used to set the number of arguments the function accepts.
  • Added BigAutoField which acts much like an AutoField except that it is guaranteed to fit numbers from 1 to 9223372036854775807.
  • QuerySet.in_bulk() may be called without any arguments to return all objects in the queryset.
  • related_query_name now supports app label and class interpolation using the '%(app_label)s' and '%(class)s' strings.
  • The prefetch_related_objects() function is now a public API.
  • QuerySet.bulk_create() sets the primary key on objects when using PostgreSQL.
  • Added the Cast database function.
  • A proxy model may now inherit multiple proxy models that share a common non-abstract parent class.

Requests and Responses

  • Added request.user to the debug view.
  • Added HttpResponse methods readable() and seekable() to make an instance a stream-like object and allow wrapping it with io.TextIOWrapper.
  • Added the HttpResponse.content_type and content_params attributes which are parsed from the CONTENT_TYPE header.
  • The parser for request.COOKIES is simplified to better match the behavior of browsers. request.COOKIES may now contain cookies that are invalid according to RFC 6265 but are possible to set via document.cookie.

Serialization

  • The django.core.serializers.json.DjangoJSONEncoder now knows how to serialize lazy strings, typically used for translatable content.

Signals

  • ...

Templates

  • Added the autoescape option to the DjangoTemplates backend and the Engine class.
  • Added the is comparison operator to the if tag.
  • Allowed dictsort to order a list of lists by an element at a specified index.

Tests

  • To better catch bugs, TestCase now checks deferrable database constraints at the end of each test.
  • Tests and test cases can be marked with tags and run selectively with the new test --tag and test --exclude-tag options.
  • Added the DATABASES['TEST']['MIGRATE'] option to allow disabling of migrations during test database creation.

URLs

  • An addition in django.setup() allows URL resolving that happens outside of the request/response cycle (e.g. in management commands and standalone scripts) to take FORCE_SCRIPT_NAME into account when it is set.

Validators

  • URLValidator now limits the length of domain name labels to 63 characters and the total length of domain names to 253 characters per RFC 1034.
  • int_list_validator() now accepts an optional allow_negative boolean parameter, defaulting to False, to allow negative integers.

Backwards incompatible changes in 1.10

Warning

In addition to the changes outlined in this section, be sure to review the Features removed in 1.10 for the features that have reached the end of their deprecation cycle and therefore been removed. If you haven’t updated your code within the deprecation timeline for a given feature, its removal may appear as a backwards incompatible change.

Database backend API

  • GIS’s AreaField uses an unspecified underlying numeric type that could in practice be any numeric Python type. decimal.Decimal values retrieved from the database are now converted to float to make it easier to combine them with values used by the GIS libraries.
  • In order to enable temporal subtraction you must set the supports_temporal_subtraction database feature flag to True and implement the DatabaseOperations.subtract_temporals() method. This method should return the SQL and parameters required to compute the difference in microseconds between the lhs and rhs arguments in the datatype used to store DurationField.

_meta.get_fields() returns consistent reverse fields for proxy models

Before Django 1.10, the get_fields() method returned different reverse fields when called on a proxy model compared to its proxied concrete class. This inconsistency was fixed by returning the full set of fields pointing to a concrete class or one of its proxies in both cases.

AbstractUser.username max_length increased to 150

A migration for django.contrib.auth.models.User.username is included. If you have a custom user model inheriting from AbstractUser, you’ll need to generate and apply a database migration for your user model.

We considered an increase to 254 characters to more easily allow the use of email addresses (which are limited to 254 characters) as usernames but rejected it due to a MySQL limitation. When using the utf8mb4 encoding (recommended for proper Unicode support), MySQL can only create unique indexes with 191 characters by default. Therefore, if you need a longer length, please use a custom user model.

If you want to preserve the 30 character limit for usernames, use a custom form when creating a user or changing usernames:

from django.contrib.auth.forms import UserCreationForm

class MyUserCreationForm(UserCreationForm):
    username = forms.CharField(
        max_length=30,
        help_text='Required. 30 characters or fewer. Letters, digits and @/./+/-/_ only.',
    )

If you wish to keep this restriction in the admin, set UserAdmin.add_form to use this form:

from django.contrib.auth.admin import UserAdmin as BaseUserAdmin
from django.contrib.auth.models import User

class UserAdmin(BaseUserAdmin):
    add_form = MyUserCreationForm

admin.site.unregister(User)
admin.site.register(User, UserAdmin)

Dropped support for PostgreSQL 9.1

Upstream support for PostgreSQL 9.1 ends in September 2016. As a consequence, Django 1.10 sets PostgreSQL 9.2 as the minimum version it officially supports.

runserver output goes through logging

Request and response handling of the runserver command is sent to the django.server logger instead of to sys.stderr. If you disable Django’s logging configuration or override it with your own, you’ll need to add the appropriate logging configuration if you want to see that output:

'formatters': {
    'django.server': {
        '()': 'django.utils.log.ServerFormatter',
        'format': '[%(server_time)s] %(message)s',
    }
},
'handlers': {
    'django.server': {
        'level': 'INFO',
        'class': 'logging.StreamHandler',
        'formatter': 'django.server',
    },
},
'loggers': {
    'django.server': {
        'handlers': ['django.server'],
        'level': 'INFO',
        'propagate': False,
    }
}

auth.CustomUser and auth.ExtensionUser test models were removed

Since the introduction of migrations for the contrib apps in Django 1.8, the tables of these custom user test models were not created anymore making them unusable in a testing context.

Apps registry is no longer auto-populated when unpickling models outside of Django

The apps registry is no longer auto-populated when unpickling models. This was added in Django 1.7.2 as an attempt to allow unpickling models outside of Django, such as in an RQ worker, without calling django.setup(), but it creates the possibility of a deadlock. To adapt your code in the case of RQ, you can provide your own worker script that calls django.setup().

Removed null assignment check for non-null foreign key fields

In older versions, assigning None to a non-nullable ForeignKey or OneToOneField raised ValueError('Cannot assign None: "model.field" does not allow null values.'). For consistency with other model fields which don’t have a similar check, this check is removed.

Removed weak password hashers from the default PASSWORD_HASHERS setting

Django 0.90 stored passwords as unsalted MD5. Django 0.91 added support for salted SHA1 with automatic upgrade of passwords when a user logs in. Django 1.4 added PBKDF2 as the default password hasher.

If you have an old Django project with MD5 or SHA1 (even salted) encoded passwords, be aware that these can be cracked fairly easily with today’s hardware. To make Django users acknowledge continued use of weak hashers, the following hashers are removed from the default PASSWORD_HASHERS setting:

'django.contrib.auth.hashers.SHA1PasswordHasher'
'django.contrib.auth.hashers.MD5PasswordHasher'
'django.contrib.auth.hashers.UnsaltedSHA1PasswordHasher'
'django.contrib.auth.hashers.UnsaltedMD5PasswordHasher'
'django.contrib.auth.hashers.CryptPasswordHasher'

Consider using a wrapped password hasher to strengthen the hashes in your database. If that’s not feasible, add the PASSWORD_HASHERS setting to your project and add back any hashers that you need.

You can check if your database has any of the removed hashers like this:

from django.contrib.auth import get_user_model
User = get_user_model()

# Unsalted MD5/SHA1:
User.objects.filter(password__startswith='md5$$')
User.objects.filter(password__startswith='sha1$$')
# Salted MD5/SHA1:
User.objects.filter(password__startswith='md5$').exclude(password__startswith='md5$$')
User.objects.filter(password__startswith='sha1$').exclude(password__startswith='sha1$$')
# Crypt hasher:
User.objects.filter(password__startswith='crypt$$')

from django.db.models import CharField
from django.db.models.functions import Length
CharField.register_lookup(Length)
# Unsalted MD5 passwords might not have an 'md5$$' prefix:
User.objects.filter(password__length=32)

Miscellaneous

  • The repr() of a QuerySet is wrapped in <QuerySet > to disambiguate it from a plain list when debugging.
  • Support for SpatiaLite < 3.0 and GEOS < 3.3 is dropped.
  • utils.version.get_version() returns PEP 440 compliant release candidate versions (e.g. ‘1.10rc1’ instead of ‘1.10c1’).
  • The LOGOUT_URL setting is removed as Django hasn’t made use of it since pre-1.0. If you use it in your project, you can add it to your project’s settings. The default value was '/accounts/logout/'.
  • The add_postgis_srs() backwards compatibility alias for django.contrib.gis.utils.add_srs_entry() is removed.
  • Objects with a close() method such as files and generators passed to HttpResponse are now closed immediately instead of when the WSGI server calls close() on the response.
  • A redundant transaction.atomic() call in QuerySet.update_or_create() is removed. This may affect query counts tested by TransactionTestCase.assertNumQueries().
  • Support for skip_validation in BaseCommand.execute(**options) is removed. Use skip_checks (added in Django 1.7) instead.
  • loaddata now raises a CommandError instead of showing a warning when the specified fixture file is not found.
  • Instead of directly accessing the LogEntry.change_message attribute, it’s now better to call the LogEntry.get_change_message() method which will provide the message in the current language.
  • The default error views now raise TemplateDoesNotExist if a nonexistent template_name is specified.
  • The unused choices keyword argument of the Select and SelectMultiple widgets’ render() method is removed. The choices argument of the render_options() method is also removed, making selected_choices the first argument.
  • On Oracle/GIS, the Area aggregate function now returns a float instead of decimal.Decimal. (It’s still wrapped in a measure of square meters.)
  • Tests that violate deferrable database constraints will now error when run on a database that supports deferrable constraints.
  • Built-in management commands now use indexing of keys in options, e.g. options['verbosity'], instead of options.get() and no longer perform any type coercion. This could be a problem if you’re calling commands using Command.execute() (which bypasses the argument parser that sets a default value) instead of call_command(). Instead of calling Command.execute(), pass the command object as the first argument to call_command().
  • ModelBackend and RemoteUserBackend now reject inactive users. This means that inactive users can’t login and will be logged out if they are switched from is_active=True to False. If you need the previous behavior, use the new AllowAllUsersModelBackend or AllowAllUsersRemoteUserBackend in AUTHENTICATION_BACKENDS instead.
  • In light of the previous change, the test client’s login() method no longer always rejects inactive users but instead delegates this decision to the authentication backend.
  • django.views.i18n.set_language() may now return a 204 status code for AJAX requests.

Features deprecated in 1.10

Direct assignment to a reverse foreign key or many-to-many relation

Instead of assigning related objects using direct assignment:

>>> new_list = [obj1, obj2, obj3]
>>> e.related_set = new_list

Use the set() method added in Django 1.9:

>>> e.related_set.set([obj1, obj2, obj3])

This prevents confusion about an assignment resulting in an implicit save.

Non-timezone-aware Storage API

The old, non-timezone-aware methods accessed_time(), created_time(), and modified_time() are deprecated in favor of the new get_*_time() methods.

Third-party storage backends should implement the new methods and mark the old ones as deprecated. Until then, the new get_*_time() methods on the base Storage class convert datetimes from the old methods as required and emit a deprecation warning as they do so.

Third-party storage backends may retain the old methods as long as they wish to support earlier versions of Django.

django.contrib.gis

  • The get_srid() and set_srid() methods of GEOSGeometry are deprecated in favor of the srid property.
  • The get_x(), set_x(), get_y(), set_y(), get_z(), and set_z() methods of Point are deprecated in favor of the x, y, and z properties.
  • The get_coords() and set_coords() methods of Point are deprecated in favor of the tuple property.
  • The cascaded_union property of MultiPolygon is deprecated in favor of the unary_union property.

CommaSeparatedIntegerField model field

CommaSeparatedIntegerField is deprecated in favor of CharField with the validate_comma_separated_integer_list() validator:

from django.core.validators import validate_comma_separated_integer_list
from django.db import models

class MyModel(models.Model):
    numbers = models.CharField(..., validators=[validate_comma_separated_integer_list])

If you’re using Oracle, CharField uses a different database field type (NVARCHAR2) than CommaSeparatedIntegerField (VARCHAR2). Depending on your database settings, this might imply a different encoding, and thus a different length (in bytes) for the same contents. If your stored values are longer than the 4000 byte limit of NVARCHAR2, you should use TextField (NCLOB) instead. In this case, if you have any queries that group by the field (e.g. annotating the model with an aggregation or using distinct()) you’ll need to change them (to defer the field).

__search query lookup

The search lookup, which supports MySQL only and is extremely limited in features, is deprecated. Replace it with a custom lookup:

from django.db import models

class Search(models.Lookup):
    lookup_name = 'search'

    def as_mysql(self, compiler, connection):
        lhs, lhs_params = self.process_lhs(compiler, connection)
        rhs, rhs_params = self.process_rhs(compiler, connection)
        params = lhs_params + rhs_params
        return 'MATCH (%s) AGAINST (%s IN BOOLEAN MODE)' % (lhs, rhs), params

models.CharField.register_lookup(Search)
models.TextField.register_lookup(Search)

Miscellaneous

  • The makemigrations --exit option is deprecated in favor of the makemigrations --check option.
  • django.utils.functional.allow_lazy() is deprecated in favor of the new keep_lazy() function which can be used with a more natural decorator syntax.
  • The shell --plain option is deprecated in favor of -i python or --interface python.
  • Importing from the django.core.urlresolvers module is deprecated in favor of its new location, django.urls.
  • The template Context.has_key() method is deprecated in favor of in.

Features removed in 1.10

These features have reached the end of their deprecation cycle and so have been removed in Django 1.10 (please see the deprecation timeline for more details):

  • Support for calling a SQLCompiler directly as an alias for calling its quote_name_unless_alias method is removed.
  • The cycle and firstof template tags are removed from the future template tag library.
  • django.conf.urls.patterns() is removed.
  • Support for the prefix argument to django.conf.urls.i18n.i18n_patterns() is removed.
  • SimpleTestCase.urls is removed.
  • Using an incorrect count of unpacked values in the for template tag raises an exception rather than failing silently.
  • The ability to reverse() URLs using a dotted Python path is removed.
  • The ability to use a dotted Python path for the LOGIN_URL and LOGIN_REDIRECT_URL settings is removed.
  • Support for optparse is dropped for custom management commands.
  • The class django.core.management.NoArgsCommand is removed.
  • django.core.context_processors module is removed.
  • django.db.models.sql.aggregates module is removed.
  • django.contrib.gis.db.models.sql.aggregates module is removed.
  • The following methods and properties of django.db.sql.query.Query are removed:
    • Properties: aggregates and aggregate_select
    • Methods: add_aggregate, set_aggregate_mask, and append_aggregate_mask.
  • django.template.resolve_variable is removed.
  • The following private APIs are removed from django.db.models.options.Options (Model._meta):
    • get_field_by_name()
    • get_all_field_names()
    • get_fields_with_model()
    • get_concrete_fields_with_model()
    • get_m2m_with_model()
    • get_all_related_objects()
    • get_all_related_objects_with_model()
    • get_all_related_many_to_many_objects()
    • get_all_related_m2m_objects_with_model()
  • The error_message argument of django.forms.RegexField is removed.
  • The unordered_list filter no longer supports old style lists.
  • Support for string view arguments to url() is removed.
  • The backward compatible shim to rename django.forms.Form._has_changed() to has_changed() is removed.
  • The removetags template filter is removed.
  • The remove_tags() and strip_entities() functions in django.utils.html is removed.
  • The is_admin_site argument to django.contrib.auth.views.password_reset() is removed.
  • django.db.models.field.subclassing.SubfieldBase is removed.
  • django.utils.checksums is removed.
  • The original_content_type_id attribute on django.contrib.admin.helpers.InlineAdminForm is removed.
  • The backwards compatibility shim to allow FormMixin.get_form() to be defined with no default value for its form_class argument is removed.
  • The following settings are removed:
    • ALLOWED_INCLUDE_ROOTS
    • TEMPLATE_CONTEXT_PROCESSORS
    • TEMPLATE_DEBUG
    • TEMPLATE_DIRS
    • TEMPLATE_LOADERS
    • TEMPLATE_STRING_IF_INVALID
  • The backwards compatibility alias django.template.loader.BaseLoader is removed.
  • Django template objects returned by get_template() and select_template() no longer accept a Context in their render() method.
  • Template response APIs enforce the use of dict and backend-dependent template objects instead of Context and Template respectively.
  • The current_app parameter for the following function and classes is removed:
    • django.shortcuts.render()
    • django.template.Context()
    • django.template.RequestContext()
    • django.template.response.TemplateResponse()
  • The dictionary and context_instance parameters for the following functions are removed:
    • django.shortcuts.render()
    • django.shortcuts.render_to_response()
    • django.template.loader.render_to_string()
  • The dirs parameter for the following functions is removed:
    • django.template.loader.get_template()
    • django.template.loader.select_template()
    • django.shortcuts.render()
    • django.shortcuts.render_to_response()
  • Session verification is enabled regardless of whether or not 'django.contrib.auth.middleware.SessionAuthenticationMiddleware' is in MIDDLEWARE_CLASSES. SessionAuthenticationMiddleware no longer has any purpose and can be removed from MIDDLEWARE_CLASSES. It’s kept as a stub until Django 2.0 as a courtesy for users who don’t read this note.
  • Private attribute django.db.models.Field.related is removed.
  • The --list option of the migrate management command is removed.
  • The ssi template tag is removed.
  • Support for the = comparison operator in the if template tag is removed.
  • The backwards compatibility shims to allow Storage.get_available_name() and Storage.save() to be defined without a max_length argument are removed.
  • Support for the legacy %(<foo>)s syntax in ModelFormMixin.success_url is removed.
  • GeoQuerySet aggregate methods collect(), extent(), extent3d(), make_line(), and unionagg() are removed.
  • The ability to specify ContentType.name when creating a content type instance is removed.
  • Support for the old signature of allow_migrate is removed.
  • Support for the syntax of {% cycle %} that uses comma-separated arguments is removed.
  • The warning that Signer issued when given an invalid separator is now a ValueError.