ext-solr - 7.0.2 - Maintenance release

Published by timohund about 7 years ago

Apache Solr for TYPO3 version 7.0.2

This release is a bugfix only release. The release contains the following bugfixes

Fix sorting counts in statistics module

The sorting counts have been caluclated wrong. This patch fixes the calculation.

See also:

https://github.com/TYPO3-Solr/ext-solr/pull/1585

Make plugin.tx_solr_PiSearch_Search available again

The TypoScript pathes to add the plugin just with TypoScript have been removed. This patch adds these pathes again.

See also:

https://github.com/TYPO3-Solr/ext-solr/pull/1643

Add default typoscript view configuration

The default fallback path was missing in the typoscript (plugin.tx_solr.view.templateRootPaths/partialRootPaths/layoutRootPaths).0

These pathes have been added to the default configuration.

See also:

https://github.com/TYPO3-Solr/ext-solr/pull/1642

Wrong parameter value for grouping fields

The parameter "group.field" was filled with the wrong data. This was fixed.

See also:

https://github.com/TYPO3-Solr/ext-solr/pull/1650

Enable escaping in TranslateViewHelper and AbstractWidgetViewHelper

The output of the TranslateViewHelper and AbstractWidgetViewHelper was not escaped. If you use user input (e.g. the querystring) in this context, the output was not properly escaped (not the case in the default partials).

Impact:

When you use the default templates and partials nothing needs to be changed
When you use a custom partial for the pagination, make sure that no html is passed to the translate ViewHelpers

Check the partial "Resources/Private/Templates/ViewHelpers/Widget/ResultPaginate/Index.html"

Avoid to pass special characters to the translate view helper, e.g. as before:

    <s:translate key="paginate_previous">&laquo;</s:translate>

Use a translation or don't use the translate ViewHelper:

    <f:if condition="{s:translate(key: 'paginate_next')}">
        <f:then><s:translate key="paginate_next" /></f:then>
        <f:else>&raquo;</f:else>
    </f:if>

See also:

https://github.com/TYPO3-Solr/ext-solr/pull/1653

Thanks

Thanks to everyone who has supported this release.

Contributors

Like always this release would not have been possible without the help from our
awesome community. Here are the contributors for this release.

(patches, comments, bug reports, reviews, ... in alphabetical order)

Jeffrey Nellissen
Jens Jacobsen
Rafael Kähm
Timo Hund
Thomas Löffler

How to Get Involved

There are many ways to get involved with Apache Solr for TYPO3:

Submit bug reports and feature requests on GitHub
Ask or help or answer questions in our Slack channel
Provide patches through Pull Request or review and comment on existing Pull Requests
Go to www.typo3-solr.com or call dkd to sponsor the ongoing development of Apache Solr for TYPO3

Support us in 2017 by becoming an EB partner:

http://www.typo3-solr.com/en/contact/

or call:

+49 (0)69 - 2475218 0

ext-solr - 7.0.1 - Maintenance release

Published by timohund about 7 years ago

Apache Solr for TYPO3 version 7.0.1

This release is a bugfix only release.

Html tag of pagination is rendered in output

To prevent the html tag from rendering of the final output, the attribute data-namespace-typo3-fluid="true" was added to the template.

https://github.com/TYPO3-Solr/ext-solr/pull/1548

Contributors

Like always this release would not have been possible without the help from our
awesome community. Here are the contributors for this release.

(patches, comments, bug reports, reviews, ... in alphabetical order)

Sascha Egerer

Also a big thanks to our partners that have joined the EB2017 program:

.hausformat
AGENTUR FRONTAG AG
amarantus - media design & conding Mario Drengner & Enrico Nemack GbR
Amedick & Sommer Neue Medien GmbH
Andrea Pausch
Animate Agentur für interaktive Medien GmbH
artig GmbH & Co. KG
b:dreizehn GmbH
BIBUS AG Group
Bitmotion GmbH
cab services ag
Causal Sarl
CHIARI GmbH
Citkomm services GmbH
clickstorm GmbH
Connecta AG
Creative360
cron IT GmbH
CYBERhouse Agentur für interaktive Kommukation GmbH
cyperfection GmbH
data-graphis GmbH
Deutsche Welthungerhilfe e.V.
Deutscher Ärzteverlag
Deutscher Volkshochschul-Verband
Die Medialen GmbH
die_schnittsteller gmbh
Dörfer engineering services
E-Magineurs
EYE Communications AG
Fachhochschule für öffentliche Verwaltung NRW Zentralverwaltung Gelsenkirchen
familie redlich AG
Fork Unstable Media GmbH
hauptsache.net GmbH
Havas Düsseldorf GmbH
Hirsch & Wölfl GmbH
Hochschule Furtwangen - IMZ Online Services
Hochschule Konstanz
Institut der deutschen Wirtschaft Köln Medien GmbH
iresults gmbh
ITK Rheinland
itl Institut für technische Literatur AG
jweiland.net
Kassenärztliche Vereinigung Rheinland-Pfalz
Kerstin Nägler Web & Social Media Beratung
Landesinstitut für Schule und Medien Berlin-Brandenburg
Leibniz Universität IT Services
Libéo
Lime Flavour GbR
LINGNER CONSULTING NEW MEDIA GMBH
LOUIS INTERNET
Maximilian Walter
MEDIA:ESSENZ
mehrwert intermediäre kommunikation GmbH
Mercedes-AMG GmbH
mlm media process management GmbH
n@work Internet Informationssystems GmbH
Netcreators
netz-haut GmbH
neuwerk interactive
Nintendo of Europe GmbH
Onedrop Solutions GmbH
Open New Media GmbH
Paints Multimedia GmbG
pixelcreation GmbH
plan2net
Pluswerk AG
polargold GmbH
punkt.de GmbH
Raiffeisen OnLine GmbH
ruhmesmeile GmbH
Rundfunk und Telekom Regulierung GmbH
Schweizer Alpen-Club SAC
sitegeist media solutions GmbH
Star Finanz-Software Entwicklung und Vertriebs GmbH
Stefan Galinski Internetdienstleistungen
Stratis - Toulon
Studio Mitte Digital Media GmbH
Studio 9 GmbH
Systime A/S
SYZYGY Deutschland GmbH
takomat Agentur GbR
THE BRETTINGHAMS GmbH
TOUMORO
Triplesense Reply GmbH
Typoheads GmbH
unternehmen online GmbH & Co. KG
Universität Bremen
VERDURE Medienteam GmbH
WACON Internet GmbH
webedit AG
Webstore GmbH
Webtech AG
wegewerk GmbH
Wohnungsbau- und Verwaltungsgesellschaft mbH Greifswald
XIMA MEDIA GmbH
zdreicom GmbH
zimmer7 GmbH

Thanks to everyone who helped in creating this release!

How to Get Involved

There are many ways to get involved with Apache Solr for TYPO3:

Submit bug reports and feature requests on GitHub
Ask or help or answer questions in our Slack channel
Provide patches through Pull Request or review and comment on existing Pull Requests
Go to www.typo3-solr.com or call dkd to sponsor the ongoing development of Apache Solr for TYPO3

Support us in 2017 by becoming an EB partner:

http://www.typo3-solr.com/en/contact/

or call:

+49 (0)69 - 2475218 0

ext-solr - 7.0.0 - Powerful templates with FLUID and Apache Solr for TYPO3

Published by timohund about 7 years ago

Apache Solr for TYPO3 7.0.0

We are happy to release EXT:solr 7.0.0. This release brings several smaller and some bigger changes

New in this release

FLUID Templating

One and a half years ago we started to implement FLUID templating for EXT:solr. This project was initially started as the addon solrfluid. Solrfuid was only available for our partners.

With EXT:solr 7.0.0 the new templating is the default templating in EXT:solr. A lot of code was added and several old stuff was removed. Since some things are conceptional different in FLUID and you also have a lot of possibilities we also dropped some parts, that can be build with fluid itself or do not make sence to do them before rendering the result in the view.

Most of the things just work like before but in the following parts we made conceptional changes (for good reasons):

No css or javascript will be added to the page automatically with the page renderer! Because the integrator wants to have control on that and TYPO3 allows to add this with TypoScript we propose to add these things via typoscript. EXT:solr offers a lot of example typoscript templates e.g. to add the default css or to add the javascript for a range facet.

The following typoscript settings have been removed because they can be implemented with FLUID:

plugin.tx_solr.search.faceting.facetLinkATagParams You can add them in your project partials. If you need it just for one facet, please overwrite the render partial with facet.partialName and render the attributes different there
plugin.tx_solr.search.faceting.[facetName].facetLinkATagParams You can add them in your project partials. If you need it just for one facet, please overwrite the render partial with facet.partialName and render the attributes different there
plugin.tx_solr.search.faceting.facets.[facetName].selectingSelectedFacetOptionRemovesFilter
This can be implemented with FLUID logic. Please check the example "Search - (Example) Options with on/off toggle" that implements that (by using the partial Facets/OptionsToggle.html)
plugin.tx_solr.search.results.fieldRenderingInstructions Please use custom ViewHelpers or the cObject ViewHelper for that.
plugin.tx_solr.search.results.fieldProcessingInstructions Please use custom ViewHelpers or the cObject ViewHelper for that.

Important: The support of fluid templating would not have been possible without the financial support of all partners! If you want to support us with the implementation of features like this, please think about to join the EB 2017 or 2018. Special thanks also to Frans Saris and beech.it for working on solrfluid together!

https://github.com/TYPO3-Solr/ext-solr/pull/1308

Backend Modules Restructured

In EXT:solr 7.0.0 the backend modules are structured into multiple backend modules. This makes the user experience in the TYPO3 backend more consistent and allows you, to give different permissions on each module.

When you login into the backend, you now have the following modules available:

Info: Gives information of your Solr system, index fields and search usage.
Core Optimization: This module can be used to maintain the synonyms and stopwords in the Apache Solr server.
Index Queue: Gives an overview on indexed records and can be used to requeue records for indexing.
Index Administration: This module can be used for administrator tasks on your solr system (clear index, index queue or reload a core)
https://github.com/TYPO3-Solr/ext-solr/pull/1300

Add excludeValues for Facets

If you want to exclude an optionValue from the facets when they get retrieved, you can configure this now:

   plugin.tx_solr.search.faceting.facets.colors_stringM.excludeValues = red

The example below will exclude the option "red" from the results when it is in the response.

https://github.com/TYPO3-Solr/ext-solr/pull/1364

Allow to configure custom entry Template

In previous EXT:solr versions it was possible to set a custom entry templating using:

   plugin.tx_solr.templateFiles.search = EXT:solr/Resources/Templates/PiSearch/search.htm

This configuration could be overwritten with a text value in the flexform.

With the move to FLUID we improved this part and made it more editor friendly:

Since the view related settings are located in the section we've move the template configuration there as well.
You can now set a Templatename only (e.g. MySearch) to benefit from FLUID fallbacks (while setting a full path is still supported.
You can configure availableTemplates that can be selected by the editor in the flexform.

The following example shows, how you can load your own partials and provide different entry templates for the editor:

   plugin.tx_solr {
       view {
           templateRootPaths.100 = EXT:your_config_extension/Resources/Private/Templates/
           partialRootPaths.100 = EXT:your_config_extension/Resources/Private/Partials/
           layoutRootPaths.100 = EXT:your_config_extension/Resources/Private/Layouts/
           templateFiles {
               results = Results
               results.availableTemplates {
                   default {
                       label = Default Searchresults Template
                       file = Results
                   }
                   products {
                       label = Products Template
                       file = ProductResults
                   }
               }
           }
       }
   }

With the prevision configuration the editor can switch from "Default Searchresults Template" to "Products Template".

Refactoring of Query API

The Query class is one of the biggest classes in EXT:solr and grown over time. This class has now been splitted into several classes.
Along with that a concept of "ParameterBuilder" has been introduced. A ParameterBuilder is responsible to build a parameter part of the query.
E.g. the Grouping ParameterBuilder is responsible to build all parameters of the solr query for the grouping.

https://github.com/TYPO3-Solr/ext-solr/pull/1385

Move FilterEncoder and FacetBuilder to Facet Package

In Solrfluid there was one folder for each facet, that contains the facet class and a parser that parsers the solr response into the facet object.
The opposite part(parse the url, build the solr query) was previously done in EXT:solr, with a FilterEncoder that was registered in the FacetRendererFactory.

Now because solrfluid and solr have been merged, this logic can also be streamlined. Every facet is now structured in a FacetPackage.

A FacetPackage describes:

Which parser should be used to parse the solr response
Which url decoder should be used to parse the EXT:solr query data
Which query builder should be used to build the faceting query part

You can also implement custom facet types by registering an on FacetPackage with the FacetRegistry.

Migration:

When you have implemented an own FacetParser for solrfluid, you should add a FacetPackage, that references a UrlDecoder and QueryBuilder.
If you have used a custom FacetParser without registring a custom facet type in EXT:solr (ApacheSolrForTypo3\Solr\Facet\FacetRendererFactory::registerFacetType) you can just reference DefaultUrlDecorder and DefaultFacerQueryBuilder in your FacetPackage.

https://github.com/TYPO3-Solr/ext-solr/pull/1319

Custom plugin namespace - Multiple Instances

Before solrfluid was merged there were several parts in EXT:solr where the data was read using GeneralUtility::_GET. The drawback of this approach is that the structure of the urls is hard to change and it is not possible to have custom namespaces for each instance of a plugin.

With solrfuid a SearchRequest object was introduced. This object holds all data from the user request. Now this object is used, whenever data from the user action is read. This allows us to make the request namespace changeable. You can now add your custom plugin namespace to a search plugin instance.

https://github.com/TYPO3-Solr/ext-solr/pull/1379

Doctrine Migration

As an ongoing task, we started with the migration of database queries to doctrine. Since the database is used in many parts of the extension there are still many parts open.
If you want to work on that, your help is very welcome.

Add --rootpageid to CLI command

If you want or need to limit the initialization of solr connections to a special rootpage, you can now do this by adding the argument --rootpageid.

https://github.com/TYPO3-Solr/ext-solr/pull/1305

Respect Setting includeInAvailableFacets and includeInUsedFacets

This setting was not evaluated in EXT:solrfluid before and is now available also with FLUID rendering.

https://github.com/TYPO3-Solr/ext-solr/pull/1340

Respect requirements facet setting with fluid

This setting was not evaluated in EXT:solrfluid before and is now available also with the FLUID rendering.

https://github.com/TYPO3-Solr/ext-solr/pull/1401

Respect setting searchUsingSpellCheckerSuggestion with fluid

This setting was not evaluated in EXT:solrfluid before and is now available also with the FLUID rendering.

https://github.com/TYPO3-Solr/ext-solr/pull/1501

Get rid of dependency to sys_domain record

By now EXT:solr had the dependency on an existing domain record. This can be a problem, when you domain is dynamic or
you need to be able to generate it.

Now you can configure a domain by the rootPageId in the TYPO3_CONF_VARS, the domain record is still used, when nothing is configured here.

$GLOBALS['TYPO3_CONF_VARS']['EXTCONF']['solr']['sites'][###rootPageId###]['domains'] = ['mydomain.com'];

Note:

There might be an approach to support this in TYPO3 Version 9 by the core and we will adopt this then.

During the implementation of this the logic to retrieve the SiteHash and get the SolrConfiguration was moved to the SiteRepository,
this requires an update of the scheduler instances because the scheduler saves a serialized task. Please run the shipped migration to
update scheduler tasks created with 6.1.x.

https://github.com/TYPO3-Solr/ext-solr/pull/1512

Preparations for TYPO3 9

Several things that will be removed with 9 have been changed:

Bugfixes

Enable zero-configuration use of Docker image: https://github.com/TYPO3-Solr/ext-solr/issues/1278
Remove unused use statement: https://github.com/TYPO3-Solr/ext-solr/pull/1292
Indexing record outside siteroot throws exception: https://github.com/TYPO3-Solr/ext-solr/pull/1299
Mounted pages from outside of the page tree lead to index queue errores: https://github.com/TYPO3-Solr/ext-solr/pull/1294
Ignore workspace in RootPageResolver: https://github.com/TYPO3-Solr/ext-solr/pull/1298
Preserve sort order when fetching related records: https://github.com/TYPO3-Solr/ext-solr/pull/1326
Fix logging of error when devlog is enabled: https://github.com/TYPO3-Solr/ext-solr/pull/1341
Tracking changes in record from other siteroot is not working as expected https://github.com/TYPO3-Solr/ext-solr/pull/1348
Relation handler should handle pages overlays correctly https://github.com/TYPO3-Solr/ext-solr/pull/1400

Removed Code

The following code has been removed since it is not used anymore:

Classes:

ScriptViewHelper
StyleViewHelper
AbstractSolrBackendViewHelper
StringUtility

Methods:

Util::camelize
Util::camelCaseToLowerCaseUnderscored
Util::underscoredToUpperCamelCase
Util::pageExists

Deprecated Code

Methods:

Query::setQueryFieldsFromString use setQueryFields(QueryFields::fromString('foo')) with QueryFields instead, will be removed in 8.0
Query::getQueryFieldsAsString use getQueryFields()->toString() now if needed, will be removed in 8.0
Query::setQueryField use getQueryFields()->set() now, will be removed in 8.0
Query::escape Use EscapeService::escape now, when needed
Query::addReturnField use getReturnFields()->add() now, will be removed in 8.0
Query::removeReturnField use getReturnFields()->remove() now, will be removed in 8.0
Query::getFieldList use getReturnFields()->getValues() now, will be removed in 8.0
Query::setFieldList use setReturnFields() now, will be removed in 8.0
Query::escapeMarkers not needed anymore, use your own implementation when needed
Query::setNumberOfGroups use getGrouping()->setNumberOfGroups() instead, will be removed in 8.0
Query::getNumberOfGroups use getGrouping()->getNumberOfGroups() instead, will be removed in 8.0
Query::addGroupField use getGrouping()->addField() instead, will be removed in 8.0
Query::getGroupFields use getGrouping()->getFields() instead, will be removed in 8.0
Query::addGroupSorting use getGrouping()->addSorting() instead, will be removed in 8.0
Query::getGroupSortings use getGrouping()->getSortings() instead, will be removed in 8.0
Query::addGroupQuery use getGrouping()->addQuery() instead, will be removed in 8.0
Query::getGroupQueries use getGrouping()->getQueries() instead, will be removed in 8.0
Query::setNumberOfResultsPerGroup use getGrouping()->setResultsPerGroup() instead, will be removed in 8.0
Query::getNumberOfResultsPerGroup use getGrouping()->getResultsPerGroup() instead, will be removed in 8.0
Query::setFacetFields use getFaceting()->setFields() instead, will be removed in 8.0
Query::addFacetField use getFaceting()->addField() instead, will be removed in 8.0
Query::removeFilter use getFilters()->removeByFieldName() instead, will be removed in 8.0
Query::removeFilterByKey use getFilters()->removeByName() instead, will be removed in 8.0
Query::removeFilterByValue use getFilters()->removeByValue() instead, will be removed in 8.0
Query::addFilter use getFilters()->add() instead, will be removed in 8.0

Method Arguments:

Query::setGrouping now expects the first argument to be a Grouping object, compatibility for the old argument (bool) will be dropped in 8.0
Query::setHighlighting now expects the first argument to be a Highlighting object, compatibility for the old arguments (bool, int) will be dropped in 8.0
Query::setFaceting now expects the first argument to be a Faceting object, compatibility for the old arguments (bool) will be dropped in 8.0

Hooks:

$GLOBALS['TYPO3_CONF_VARS']['EXTCONF']['solr']['modifySearchResponse'] has been marked as deprecated and will be dropped in 8.0 please use a SearchResultSetProcessor registered in $GLOBALS['TYPO3_CONF_VARS']['EXTCONF']['solr']['afterSearch'] as replacement.
$GLOBALS['TYPO3_CONF_VARS']['EXTCONF']['solr']['processSearchResponse'] has been marked as deprecated and will be dropped in 8.0 please use a SearchResultSetProcessor registered in $GLOBALS['TYPO3_CONF_VARS']['EXTCONF']['solr']['afterSearch'] as replacement.

Contributors

Like always this release would not have been possible without the help from our
awesome community. Here are the contributors for this release.

(patches, comments, bug reports, reviews, ... in alphabetical order)

Andreas Lappe
Felix Eckhofer
Frans Saris
Georg Ringer
Helmut Hummel
Jonas Ulrich
Marco Bresch
Markus Friedrich
Michael Skrynski
Rafael Kähm
Rémy DANIEL
Sascha Egerer
Sebastian Hofer
Timo Hund

Also a big thanks to our partners that have joined the EB2017 program:

.hausformat
AGENTUR FRONTAG AG
amarantus - media design & conding Mario Drengner & Enrico Nemack GbR
Amedick & Sommer Neue Medien GmbH
Andrea Pausch
Animate Agentur für interaktive Medien GmbH
artig GmbH & Co. KG
b:dreizehn GmbH
BIBUS AG Group
Bitmotion GmbH
cab services ag
Causal Sarl
CHIARI GmbH
Citkomm services GmbH
clickstorm GmbH
Connecta AG
Creative360
cron IT GmbH
CYBERhouse Agentur für interaktive Kommukation GmbH
cyperfection GmbH
data-graphis GmbH
Deutsche Welthungerhilfe e.V.
Deutscher Ärzteverlag
Deutscher Volkshochschul-Verband
Die Medialen GmbH
die_schnittsteller gmbh
Dörfer engineering services
E-Magineurs
EYE Communications AG
Fachhochschule für öffentliche Verwaltung NRW Zentralverwaltung Gelsenkirchen
familie redlich AG
Fork Unstable Media GmbH
hauptsache.net GmbH
Havas Düsseldorf GmbH
Hirsch & Wölfl GmbH
Hochschule Furtwangen - IMZ Online Services
Hochschule Konstanz
Institut der deutschen Wirtschaft Köln Medien GmbH
iresults gmbh
ITK Rheinland
itl Institut für technische Literatur AG
jweiland.net
Kassenärztliche Vereinigung Rheinland-Pfalz
Kerstin Nägler Web & Social Media Beratung
Landesinstitut für Schule und Medien Berlin-Brandenburg
Leibniz Universität IT Services
Libéo
Lime Flavour GbR
LINGNER CONSULTING NEW MEDIA GMBH
LOUIS INTERNET
Maximilian Walter
MEDIA:ESSENZ
mehrwert intermediäre kommunikation GmbH
Mercedes-AMG GmbH
mlm media process management GmbH
n@work Internet Informationssystems GmbH
Netcreators
netz-haut GmbH
neuwerk interactive
Nintendo of Europe GmbH
Onedrop Solutions GmbH
Open New Media GmbH
Paints Multimedia GmbG
pixelcreation GmbH
plan2net
Pluswerk AG
polargold GmbH
punkt.de GmbH
Raiffeisen OnLine GmbH
ruhmesmeile GmbH
Rundfunk und Telekom Regulierung GmbH
Schweizer Alpen-Club SAC
sitegeist media solutions GmbH
Star Finanz-Software Entwicklung und Vertriebs GmbH
Stefan Galinski Internetdienstleistungen
Stratis - Toulon
Studio Mitte Digital Media GmbH
Studio 9 GmbH
Systime A/S
SYZYGY Deutschland GmbH
takomat Agentur GbR
THE BRETTINGHAMS GmbH
TOUMORO
Triplesense Reply GmbH
Typoheads GmbH
unternehmen online GmbH & Co. KG
Universität Bremen
VERDURE Medienteam GmbH
WACON Internet GmbH
webedit AG
Webstore GmbH
Webtech AG
wegewerk GmbH
Wohnungsbau- und Verwaltungsgesellschaft mbH Greifswald
XIMA MEDIA GmbH
zdreicom GmbH
zimmer7 GmbH

Thanks to everyone who helped in creating this release!

Outlook

In the next release we want to focus on the user experience in the backend and in the frontend. As preparation we collected several tasks.

The goal of some of them (e.g. bootstrap templating, checkbox facets, filterable options partial) is to make more things possible out of the box and make the extension more user friendly:

https://github.com/TYPO3-Solr/ext-solr/issues?q=is%3Aissue+is%3Aopen+label%3AUX

If you have allready implemented one this (or something else), that you want to share or make available outofthebox feel free to contanct us!

How to Get Involved

There are many ways to get involved with Apache Solr for TYPO3:

Submit bug reports and feature requests on GitHub
Ask or help or answer questions in our Slack channel
Provide patches through Pull Request or review and comment on existing Pull Requests
Go to www.typo3-solr.com or call dkd to sponsor the ongoing development of Apache Solr for TYPO3

Support us in 2017 by becoming an EB partner:

http://www.typo3-solr.com/en/contact/

or call:

+49 (0)69 - 2475218 0

ext-solr - 6.1.3 - Maintenance release

Published by timohund about 7 years ago

Apache Solr for TYPO3 version 6.1.3 released

This release is a bugfix only release.

Optimize composer.json

This change:

Removes "minimum-stability": "alpha" from the composer.json
Removes "optimize-autoloader": true from the composer.json
Adds "extension-key": "solr" to the composer json.

https://github.com/TYPO3-Solr/ext-solr/pull/1527

Escape output of ScoreCalculation

Applies htmlspecialchars on the output of the ScoreCalculation.
https://github.com/TYPO3-Solr/ext-solr/pull/1528

Escape output of SiteSelector

Applies htmlspecialchars on the output of the SiteSelector.

https://github.com/TYPO3-Solr/ext-solr/pull/1533

Relation handler should handle pages overlays correctly

The relation handler did not handle page overlays correctly before.
This pr provides a fix to handle the translation of pages correctly.

https://github.com/TYPO3-Solr/ext-solr/pull/1535

Contributors

Like always this release would not have been possible without the help from our
awesome community. Here are the contributors for this release.

(patches, comments, bug reports, reviews, ... in alphabetical order)

Frans Saris
Georg Ringer
Rafael Kähm
Timo Hund

Also a big thanks to our partners that have joined the EB2017 program:

.hausformat
AGENTUR FRONTAG AG
amarantus - media design & conding Mario Drengner & Enrico Nemack GbR
Amedick & Sommer Neue Medien GmbH
Andrea Pausch
Animate Agentur für interaktive Medien GmbH
artig GmbH & Co. KG
b:dreizehn GmbH
BIBUS AG Group
Bitmotion GmbH
cab services ag
Causal Sarl
Citkomm services GmbH
clickstorm GmbH
Creative360
cron IT GmbH
CYBERhouse Agentur für interaktive Kommukation GmbH
data-graphis GmbH
Deutscher Ärzteverlag
Deutscher Volkshochschul-Verband
Die Medialen GmbH
die_schnittsteller gmbh
Dörfer engineering services
E-Magineurs
EYE Communications AG
Fachhochschule für öffentliche Verwaltung NRW Zentralverwaltung Gelsenkirchen
familie redlich AG
Fork Unstable Media GmbH
hauptsache.net GmbH
Havas Düsseldorf GmbH
Hirsch & Wölfl GmbH
Hochschule Furtwangen - IMZ Online Services
Hochschule Konstanz
Institut der deutschen Wirtschaft Köln Medien GmbH
iresults gmbh
ITK Rheinland
itl Institut für technische Literatur AG
jweiland.net
Kassenärztliche Vereinigung Rheinland-Pfalz
Kerstin Nägler Web & Social Media Beratung
Landesinstitut für Schule und Medien Berlin-Brandenburg
Leibniz Universität IT Services
Lime Flavour GbR
LOUIS INTERNET
Maximilian Walter
MEDIA:ESSENZ
mehrwert intermediäre kommunikation GmbH
Mercedes-AMG GmbH
mlm media process management GmbH
n@work Internet Informationssystems GmbH
Netcreators
netz-haut GmbH
neuwerk interactive
Nintendo of Europe GmbH
Onedrop Solutions GmbH
Paints Multimedia GmbG
pixelcreation GmbH
plan2net
Pluswerk AG
polargold GmbH
punkt.de GmbH
Raiffeisen OnLine GmbH
ruhmesmeile GmbH
Rundfunk und Telekom Regulierung GmbH
Schweizer Alpen-Club SAC
sitegeist media solutions GmbH
Star Finanz-Software Entwicklung und Vertriebs GmbH
Stefan Galinski Internetdienstleistungen
Stratis - Toulon
Studio 9 GmbH
Systime A/S
SYZYGY Deutschland GmbH
takomat Agentur GbR
THE BRETTINGHAMS GmbH
TOUMORO
Triplesense Reply GmbH
Typoheads GmbH
Universität Bremen
VERDURE Medienteam GmbH
WACON Internet GmbH
webedit AG
Webstore GmbH
Webtech AG
wegewerk GmbH
Wohnungsbau- und Verwaltungsgesellschaft mbH Greifswald
XIMA MEDIA GmbH
zdreicom GmbH
zimmer7 GmbH

Thanks to everyone who helped in creating this release!

How to Get Involved

There are many ways to get involved with Apache Solr for TYPO3:

Submit bug reports and feature requests on GitHub
Ask or help or answer questions in our Slack channel
Provide patches through Pull Request or review and comment on existing Pull Requests
Go to www.typo3-solr.com or call dkd to sponsor the ongoing development of Apache Solr for TYPO3

Support us in 2017 by becoming an EB partner:

http://www.typo3-solr.com/en/contact/

or call:

+49 (0)69 - 2475218 0

ext-solr - 6.1.2 - Maintenance release

Published by timohund over 7 years ago

6.1.2 - Maintenance release

Apache Solr for TYPO3 version 6.1.2 released

This release is a bugfix only release.

Missing parameter type in FrequentSearches::postInitializeTemplateEngine

This missing parameter type leads to a warning in PHP7.

https://github.com/TYPO3-Solr/ext-solr/pull/1386

Enable zero-configuration use of Docker image

Creates the datafolder before giving the permissions and allows to use the Dockerfile without further configuration.

https://github.com/TYPO3-Solr/ext-solr/issues/1278

Allow 'hide default translation of page' on root page

If the root page is set to 'hide default translation of page' this causes a 404 in TypoScriptFrontendController with initializing the TSFE. To avoid this a language uid has to be thrown to the initialize function.

https://github.com/TYPO3-Solr/ext-solr/pull/1414

Language is lost for link in custom record with sys_language_mode = content_fallback

A cache in getFullItemRecord avoids the correct initialization of the TSFE. Since Util::initializeTsfe is cached anyways, this cache could be removed and makes sure that a proper TSFE is initialized.

Contributors

Like always this release would not have been possible without the help from our
awesome community. Here are the contributors for this release.

(patches, comments, bug reports, reviews, ... in alphabetical order)

Hannes Lau
Markus Friedrich
Patrick Schriner
Sebastian Hofer
Timo Hund

Also a big thanks to our partners that have joined the EB2017 program:

.hausformat
AGENTUR FRONTAG AG
amarantus - media design & conding Mario Drengner & Enrico Nemack GbR
Amedick & Sommer Neue Medien GmbH
Andrea Pausch
Animate Agentur für interaktive Medien GmbH
artig GmbH & Co. KG
b:dreizehn GmbH
BIBUS AG Group
Bitmotion GmbH
cab services ag
Causal Sarl
Citkomm services GmbH
clickstorm GmbH
Creative360
cron IT GmbH
CYBERhouse Agentur für interaktive Kommukation GmbH
data-graphis GmbH
Deutscher Ärzteverlag
Deutscher Volkshochschul-Verband
Die Medialen GmbH
die_schnittsteller gmbh
Dörfer engineering services
E-Magineurs
EYE Communications AG
Fachhochschule für öffentliche Verwaltung NRW Zentralverwaltung Gelsenkirchen
familie redlich AG
Fork Unstable Media GmbH
hauptsache.net GmbH
Havas Düsseldorf GmbH
Hirsch & Wölfl GmbH
Hochschule Furtwangen - IMZ Online Services
Hochschule Konstanz
Institut der deutschen Wirtschaft Köln Medien GmbH
iresults gmbh
ITK Rheinland
itl Institut für technische Literatur AG
jweiland.net
Kassenärztliche Vereinigung Rheinland-Pfalz
Kerstin Nägler Web & Social Media Beratung
Landesinstitut für Schule und Medien Berlin-Brandenburg
Leibniz Universität IT Services
Lime Flavour GbR
LOUIS INTERNET
Maximilian Walter
MEDIA:ESSENZ
mehrwert intermediäre kommunikation GmbH
Mercedes-AMG GmbH
mlm media process management GmbH
n@work Internet Informationssystems GmbH
Netcreators
netz-haut GmbH
neuwerk interactive
Nintendo of Europe GmbH
Onedrop Solutions GmbH
Paints Multimedia GmbG
pixelcreation GmbH
plan2net
Pluswerk AG
polargold GmbH
punkt.de GmbH
Raiffeisen OnLine GmbH
ruhmesmeile GmbH
Rundfunk und Telekom Regulierung GmbH
Schweizer Alpen-Club SAC
sitegeist media solutions GmbH
Star Finanz-Software Entwicklung und Vertriebs GmbH
Stefan Galinski Internetdienstleistungen
Stratis - Toulon
Studio 9 GmbH
Systime A/S
SYZYGY Deutschland GmbH
takomat Agentur GbR
THE BRETTINGHAMS GmbH
TOUMORO
Triplesense Reply GmbH
Typoheads GmbH
Universität Bremen
VERDURE Medienteam GmbH
WACON Internet GmbH
webedit AG
Webstore GmbH
Webtech AG
wegewerk GmbH
Wohnungsbau- und Verwaltungsgesellschaft mbH Greifswald
XIMA MEDIA GmbH
zdreicom GmbH
zimmer7 GmbH

Thanks to everyone who helped in creating this release!

How to Get Involved

There are many ways to get involved with Apache Solr for TYPO3:

Submit bug reports and feature requests on GitHub
Ask or help or answer questions in our Slack channel
Provide patches through Pull Request or review and comment on existing Pull Requests
Go to www.typo3-solr.com or call dkd to sponsor the ongoing development of Apache Solr for TYPO3

Support us in 2017 by becoming an EB partner:

http://www.typo3-solr.com/en/contact/

or call:

+49 (0)69 - 2475218 0

ext-solr - 6.1.1 - Maintenance release

Published by timohund over 7 years ago

Apache Solr for TYPO3 version 6.1.1 released

This release is a bugfix only release.

Ignore workspaces in RootPageResolver

When the rootPage resolver was called with $pageId = -1 it tried to check if this is really a rootPage.
Since we know that this is a workspace page, the RootPageResolver returns false now.

https://github.com/TYPO3-Solr/ext-solr/issues/1277

Allow to limit the solr:updateConnections command to a rootpageid

To be able to initialize only a few connections the option --rootpageid was added.

https://github.com/TYPO3-Solr/ext-solr/issues/1288

Indexing records outside the rootline throws Exception

The Indexer uses the item record page to resolve the configuration. This can lead to problems when the records is outside a siteroot because the configuration is not present there.

This fix uses the configuration of the siteroot when no configuration is present as fallback to have an indexing configuration available.

https://github.com/TYPO3-Solr/ext-solr/issues/1291

Tracking changes in records of other siteroots is not working as expected

The following scenario is given:

Site a
Site b

Site a references record from site b in additionalPageIds. When a change is done in the record we expect that the index queue item for both sites is created, since it is referenced in both sides. By now the tracking of the record outside the siteroot is only working when the referenced record does not belong to another site.

https://github.com/TYPO3-Solr/ext-solr/issues/1347

Contributors

Like always this release would not have been possible without the help from our
awesome community. Here are the contributors for this release.

(patches, comments, bug reports, reviews, ... in alphabetical order)

Andreas Lappe
Markus Friedrich
Rafael Kähm
Rémy Daniel
Timo Hund

Also a big thanks to our partners that have joined the EB2017 program:

Amedick & Sommer
amarantus - media design & coding Mario Drengner & Enrico Nemack GbR
Animate Agentur für interaktive Medien GmbH
artif GmbH & Co. KG
AVM Computersysteme Vertriebs GmbH
b:dreizehn GmbH
Bitmotion GmbH
cab services ag
Causal Sàrl
Creative360
cron IT GmbH
data-graphics GmbH
Deutscher Ärzteverlag GmbH
Deutscher Volkshochschul-Verband
Die Medialen GmbH
dörler engineering services
hauptsache.net
Havas Düsseldorf GmbH
itl AG
jweiland.net
KEMWEB GmbH & Co. KG
Leibniz Universität IT Services, Hannover
Lime Flavour GbR
LOUIS INTERNET
Maximillian Walter
Mercedes-AMG GmbH
mpm media process management GmbH
n@work Internet Informationssysteme GmbH
Netcreators BV (Netherlands)
NetSpring s.r.l.
netz-haut GmbH
polar gold
punkt.de
sitegeist media solutions GmbH
Star Finanz GmbH
Studio 9 GmbH
stratis
systime
takomat Agentur GbR
Triplesense Reply
Typoheads GmbH
UEBERBIT GmbH
WACON Internet GmbH
Universität Bremen
webconsulting business services gmbh
zdreicom AG
zimmer7 GmbH

Thanks to everyone who helped in creating this release!

How to Get Involved

There are many ways to get involved with Apache Solr for TYPO3:

Submit bug reports and feature requests on GitHub
Ask or help or answer questions in our Slack channel
Provide patches through Pull Request or review and comment on existing Pull Requests
Go to www.typo3-solr.com or call dkd to sponsor the ongoing development of Apache Solr for TYPO3

Support us in 2017 by becoming an EB partner:

http://www.typo3-solr.com/en/contact/

or call:

+49 (0)69 - 2475218 0

ext-solr - 6.1.0 - Ready for TYPO3 8 LTS

Published by timohund over 7 years ago

We are ready for TYPO3 8 LTS - EXT:solr 6.1 has been released

Close to the release of TYPO3 8 LTS we are happy to announce EXT:solr 6.1 that is compatible with TYPO3 8 LTS.

New in this Release

In this release we've merged over 160 pull requests! With these pull requests several new features and bugfixes were added.

Compatible with TYPO3 8 LTS and PHP 7.1 ready

EXT:solr 6.1 is ready for TYPO3 8 LTS and php 7.1 while keeping the compatibility to TYPO3 7.6 LTS and PHP 5.5 and 5.6.

Backend Performance Improvements

During the development of version 6.1 there have been a lot of smaller and bigger performance improvements.
The following changes might be interesting.

Allow to use the closest configuration in the page tree

When a record is saved in the backend by now the whole typoscript configuration is evaluated for the page where the record is located. In many setups it is enough to just use the closest template in the rootline to parse the configuration.
Since there are cases, where this method does not work (e.g. when you use conditions based on page ids) you need to switch this behaviour explicitly on, by enable "useConfigurationFromClosestTemplate".

https://github.com/TYPO3-Solr/ext-solr/issues/937

Add caching when record monitor is used

To optimize the performance the RecordMonitor and GarbageCollector class have been splitted into several components. These components use the TYPO3 caching framework to cache result that do not need to be retrieved multiple times.

Add a global list of monitored tables

If a record is relevant can only be decided in the context of a solr site because the typoscript configuration defines the indexing configuration.

When you want to tweek the backend performance you can define a global list of monitoredTables. Other tables will then be ignored and also the parsing of the typoscript configuration is not needed then.

https://github.com/TYPO3-Solr/ext-solr/issues/1115

New Index Inspector

Since extjs will be removed more and more from the TYPO3 core we decided to migrate the index inspector to fluid.
You can use the index inspector as usual from "Web > Info > Search Index Inspector" to analyze which documents are in the
solr server for a specific page.

Related Issues:

Allow to monitor records outside the siteroot

When the property "additionalPageIds" is configured for an indexing configuration this configuration is now taken into account in the record monitor to re-queue these elements when a change in the backend is done.

Since this is an expensive operation, you can disable this feature by configuring the extension setting (useConfigurationTrackRecordsOutsideSiteroot) in the extension manager.

Related Issues:

https://github.com/TYPO3-Solr/ext-solr/issues/485

Use TYPO3 logging framework instead of devlog

By now the devLog from TYPO3 was used to log messages in the extension. Since several years there is a more flexible logging framework available in the TYPO3 core.
In EXT:solr 6.1 we make use of this and use the TYPO3 logging framework to write the logs.

Related Issues:

https://github.com/TYPO3-Solr/ext-solr/issues/490

Use ::class and shorten array syntax

The minimum php version (PHP 5.5) allows us to benefit from PHP language features that make the code more readable:

Short array syntax: We replaced the parts in the code where [] can be used instead of array()
::class: By using ::class all places where classes get instanciated with GeneralUtility::makeInstance can be simplyfied

Related Issues:

Support partial matches with N-Gram and Edge N-Gram

For some search use cases it makes sence to support partial matches e.g. when you search for "boch" and want to mach a field with the content "bochum".

EXT:solr 6.1.0 shippes new dynamic field types that make "N-Gram" and "Edge N-Gram" processed fields available:

Edge N-Gram Singlevalue: \*_textEdgeNgramS Edge Ngram (hello => hello, hell..)
Edge N-Gram Multivalue: \*_textEdgeNgramM Edge Ngram (hello => hello, hell..)
N-Gram Singlevalue: \*_textNgramS Ngram (hello => he,ll,lo,hel,llo)
N-Gram Multivalue: \*_textNgramM Ngram (hello => he,ll,lo,hel,llo)

Related Issues:

https://github.com/TYPO3-Solr/ext-solr/issues/906

Allow to disable siteHash check by using allowedSites = *

The siteHash is unique for a solr site in the TYPO3 system. When solr does a query the allowedSites setting can be used to control the set of documents that are queried in a solr core.
This is useful when you want to split the content from multiple sites in a single solr core. In some cases it is useful to disable this limitation.

E.g. when:

You have data in solr that comes from another system
When you want to search across multiple sites

Before the extension "solr_disablesitehash" was required to turn this sitehash check off. With solr 6.1.0 we've changed the meaning of the allowedSites:

Before: * was the same as __all, which means all sites in the system
After: __all is still handled as __all sites in the system, but * now means every site (same as no check at all)

Migration: When you are using * for query.allowedSites change the setting to __all.

Related Issues:

https://github.com/TYPO3-Solr/ext-solr/issues/862

Update jQuery version

In this release we have updated the shipped jQuery and jQueryUi components to the following versions:

jQuery: v3.1.1
jQuery UI: v1.12.1

Related Issues:

https://github.com/TYPO3-Solr/ext-solr/issues/518

Fix scrutinizer issues

A lot of issues (formatting, small bugs, documentation,...) reported by scrutinizer have been resolved in this release.

Related Issues:

Add solr access filter plugin 2.0.0

The solr access filter plugin has been optimized to use a solr post filter. By using a post filter the performance of this plugin is much better, because less documents need to be evaluated.
In this release we ship this new version 2.0.0 of the access filter with the default configSet and in our docker container.

Related Issues:

https://github.com/TYPO3-Solr/ext-solr/issues/933

Preparation for Doctrine migration

In the next release we will drop the support of TYPO3 7 LTS and only support 8 LTS. Since in the TYPO3 core the database access was migrated to Doctrine, we will use Doctrine as well.

To simplify this, we have centralized a lot of database queries in this release and also dropped duplicate queries to reduce to amount of work that needs to be done for this in the next releaese.

Related Issues:

Allow self signed ssl certificates

Not every project can use officially signed SSL certificates for all stages. Because of that we allowed for the page indexing to index a host, with a self signed certificate.

You can enable this feature by configuring the extension setting (allowSelfSignedCertificates) in the extension manager to true.

Related Issues:

Add cObject support for solr settings

When you use EXT:solr in a deployment scenario (e.g. platform.sh) you maybe want to define the solr endpoints by environment variables or from variables in TYPO3_CONF_VARS. Both approaches are supported by the typoscript TEXT object.
Therefore it makes sence for the solr endpoint settings in plugin.tx_solr.solr to support the usage of cObjects there. This allows you to define connections like this:

Addition to AdditionalConfiguration.php:

$GLOBALS['TYPO3_CONF_VARS']['EXTCONF']['solr']['host'] = 'mysolrserver.de';

Usage in Typoscript:

plugin.tx_solr.solr {
    host = TEXT
    host {
        value = localhost
        override.data = global:TYPO3_CONF_VARS|EXTCONF|solr|host
    }
}

Related Issues:

https://github.com/TYPO3-Solr/ext-solr/issues/868

Deprecated code

For the continues improvement of the codestructure and preparation for upcoming tasks, the following methods have been marked as deprecated and will be removed in EXT:solr 7.0 (next release):

GarbageCollector::cleanIndex
Query::addSortField
Query::getSortingFields
SolrService::getSchemaName
Util::timestampToIso
Util::isoToTimestamp
Util::timestampToUtcIso
Util::utcIsoToTimestamp
Util::getRootPageId
Util::isRootPage
Util::getSiteHashForDomain
Util::resolveSiteHashAllowedSites
Item::updateIndexedTime
Queue::getIndexingConfigurationByItem
Queue::getIndexingConfigurationsByItem
Queue::getItemsCountBySite
Queue::getRemainingItemsCountBySite
TypoScriptConfiguration::getIndexQueuePagesAllowedPageTypesArray
QueryTest::canAddSortField
Site::getLanguages
Site::getFirstAvailableSite
Site::getAvailableSites
Site::getAvailableSitesSelector

Please check your deprecation log and replace the usages in your code.

Breaking changes

In this release some breaking changes have been required. Please follow the notes below when you migrate from 6.0 to 6.1

Default variantId changed

The default variantId was table/uid before since this id is not unique across multiple TYPO3 system, a system hash was added before.
The scheme of the new variantId is systemhash/table/uid and allows to use grouping when data from multiple TYPO3 systems get indexed and searched.

Migration:

Reindex the solr data to get the new variantId.

Related Issues:

https://github.com/TYPO3-Solr/ext-solr/issues/862

Semantic of allowedSites changed

Migration:

When you use plugin.tx_solr.search.query.allowedSites = * you should now use plugin.tx_solr.search.query.allowedSites = __all

Related Issues:

https://github.com/TYPO3-Solr/ext-solr/issues/862

Setting debugDevlogOutput replaced by debugOutput

Because the devLog was replaced by the logging framework, the setting plugin.tx_solr.logging.debugDevlogOutput does not make sence anymore.

Migration:

When you want to see the log output in the backend or frontend please use plugin.tx_solr.logging.debugOutput now.

Related Issues:

https://github.com/TYPO3-Solr/ext-solr/issues/490

"Only variables should be assigned by reference" in IndexQueue\Indexer::preAddModifyDocuments()

Along we the removal of the reference GeneralUtility::getUserObj was replaced with GeneralUtility::makeInstance, because the usage with ":" is deprecated since TYPO3 8 and will be removed.

Migration:

When you reference custom indexer (in $GLOBALS['TYPO3_CONF_VARS']['EXTCONF']['solr']['IndexQueueIndexer']['indexItemAddDocuments']) you should reference only an autoloadable classname.

The following steps are required:

Move your Indexer to an own extension with proper autoloading configuration
Reference the autoloadable classname

Related Issues:

https://github.com/TYPO3-Solr/ext-solr/issues/1183

Bugfixes

StatisticRepository::getTopKeyWordsWithOrWithoutHits $limit, $withoutHits have no default values

https://github.com/TYPO3-Solr/ext-solr/issues/1143

Wrong TS path in frontendDataHelper documentation

https://github.com/TYPO3-Solr/ext-solr/issues/964

Invalid include paths after scheduler run

https://github.com/TYPO3-Solr/ext-solr/issues/921

Backend Summary not working

https://github.com/TYPO3-Solr/ext-solr/issues/731

Queue initialization returns wrong (duplicate) results for second site root in multisite environment

https://github.com/TYPO3-Solr/ext-solr/issues/488

solrconfig.xml More Like This Handler configuration is broken

https://github.com/TYPO3-Solr/ext-solr/issues/765

Fix position of default stopwords

https://github.com/TYPO3-Solr/ext-solr/issues/578

Bug/unwanted feature in method getPages in Site.php

https://github.com/TYPO3-Solr/ext-solr/issues/652

Custom field is not indexed for custom page queue configuration

https://github.com/TYPO3-Solr/ext-solr/issues/842

GarbageCollector fails to check endtime correctly

https://github.com/TYPO3-Solr/ext-solr/issues/1212

"Only variables should be assigned by reference" in IndexQueue\Indexer::preAddModifyDocuments()

https://github.com/TYPO3-Solr/ext-solr/issues/1183

Use urlencode for deletion of synonyms and stopwords

https://github.com/TYPO3-Solr/ext-solr/issues/1205
https://github.com/TYPO3-Solr/ext-solr/issues/1206

Outlook

This is the last release for TYPO3 7.6 LTS and the last release with marker based templating. The next release (7.0.0) will drop the marked based templating and will require TYPO3 8 LTS. If you want to start with fluid templating now we suggest to use solrfluid (available as EB partner)

Thanks

Thanks to everyone who has supported the release of EXT:solr 6.1.0.

Contributors

Like always this release would not have been possible without the help from our
awesome community. Here are the contributors for this release.

(patches, comments, bug reports, reviews, ... in alphabetical order)

Andreas Allacher
Andriy Oprysko
Arno Schoon
Frank Nägler
Frans Saris
Ingo Renner
Josef Glatz
Markus Kobligk
Rafael Kähm
Rasmus Larsen
Sascha Egerer
Thomas Hohn
Timo Hund
Tomas Norre Mikkelsen

Also a big thanks to our partners that have joined the EB2017 program:

Amedick & Sommer
amarantus - media design & coding Mario Drengner & Enrico Nemack GbR
Animate Agentur für interaktive Medien GmbH
artif GmbH & Co. KG
AVM Computersysteme Vertriebs GmbH
b:dreizehn GmbH
Bitmotion GmbH
cab services ag
Causal Sàrl
Creative360
cron IT GmbH
data-graphics GmbH
Deutscher Ärzteverlag GmbH
Deutscher Volkshochschul-Verband
Die Medialen GmbH
dörler engineering services
hauptsache.net
Havas Düsseldorf GmbH
itl AG
jweiland.net
KEMWEB GmbH & Co. KG
Leibniz Universität IT Services, Hannover
Lime Flavour GbR
LOUIS INTERNET
Maximillian Walter
Mercedes-AMG GmbH
mpm media process management GmbH
n@work Internet Informationssysteme GmbH
Netcreators BV (Netherlands)
NetSpring s.r.l.
netz-haut GmbH
polar gold
punkt.de
sitegeist media solutions GmbH
Star Finanz GmbH
Studio 9 GmbH
stratis
systime
takomat Agentur GbR
Triplesense Reply
Typoheads GmbH
UEBERBIT GmbH
WACON Internet GmbH
Universität Bremen
webconsulting business services gmbh
zdreicom AG
zimmer7 GmbH

Thanks to everyone who helped in creating this release!

How to get Involved

There are many ways to get involved with Apache Solr for TYPO3:

Submit bug reports and feature requests on GitHub
Ask or help or answer questions in our Slack channel
Provide patches through Pull Request or review and comment on existing Pull Requests
Go to www.typo3-solr.com or call dkd to sponsor the ongoing development of Apache Solr for TYPO3

Support us in 2017 by becoming an EB partner:

http://www.typo3-solr.com/en/contact/

or call:

+49 (0)69 - 2475218 0

ext-solr - 6.0.1 - Maintenance release

Published by timohund over 7 years ago

Apache Solr for TYPO3 version 6.0.1 released

This release is a bugfix only release.

Empty username or password lead to authentication with empty credentials

When no username of password was configured an authentication with empty credentials was done.

#1182

Error when solr path consists of more then two segments

When the solr path has more then two segments (e.g. /solr/core) a core reload failed.

#1211

ext-solr - 6.0.0 - Support of Apache Solr 6.3 / Docker Images & Performance Tuning

Published by timohund almost 8 years ago

Dia dhuit - Hello "Apache Solr for TYPO3" 6.0

We're happy to announce the release of Apache Solr for TYPO3 (EXT:solr) version 6.0.0.
With this release we ship support for Apache Solr 6.3 and provide a Docker file, that
can be used to spin up a Solr server configured and ready to run within a few steps.
Besides that the release contains many other features and bugfixes.

New in This Release

In this release we've merged over 120 pull requests!
With these pull requests several new features and bugfixes were added.

Apache Solr 6.3 Support

The focus of this release was adding support for the latest version of Apache Solr
and making setup easier. Configuration of Apache Solr is now provided via configSets.
A configSet contains everything you need - solrconfig.xml, schema.xml & custom
access filter jar files - to configure and run a Solr server for use with TYPO3.

Related PRs:

Access Filter Support for multi-value Access Fields

The next release of EXT:solrfal will allow merging of duplicates into one document.
The implementation of this feature requires that the permissions are stored in a multi-value
field because different references to a file can have different permissions.
Thus the access field is now a multi-value field and the access filter plugin
is able to evaluate multiple access values.

Fluid Templates for System Status Reports

By using the Fluid standalone views we have adapted the status reports
to use these views and create better output.

Support for New Languages (Irish, Serbian and Latvian)

With the new Apache Solr version we have added languages Irish, Serbian, and Latvian.
You can now use them to index sites in these languages by creating a Solr core using the
configuration provided by the extension.

Use Extbase Command Controller to Update Connections

The old cli commands have been replaced with an Extbase command controller.

Please use the following commands to update Solr connections through cli:

php ./typo3/cli_dispatch.phpsh extbase solr:updateConnections

Closer to 8 LTS

Our goal is to be able to support TYPO3 CMS v8 as soon as version 8 LTS will be released.
Many patches from the community have been merged to improve the compatibility for version 8 already.
Thanks to everyone who worked on that and provided contributions!

Related PRs:

Performance Improvements

Avoid schema retrieval:

Until now the Solr schema was fetched in the frontend even when it was not needed.
Now we only fetch the schema in the backend when it's really needed (when updating stopswords or synonyms).

Reduce ping requests:

The amount of ping requests has been reduced to only do one ping when the plugin is rendered.

Improved configuration caching:

Configuration object, are now cached in an in memory cache. This gives an improvement when pages in the backend are copied.

Related PRs:

Allow Solr Server-Side Facet Option Limits

Until now you could only limit the facet options shown when they get rendered in the frontend.
Sometimes however you want to reduce the available facet options at an earlier time when
retrieving them from Solr.

The following setting now allows you to configure this limit:

plugin.tx_solr.search.faceting.facetLimit = 50

Related PRs:

https://github.com/TYPO3-Solr/ext-solr/issues/724

Improved Code Quality With Scrutinizer

To ensure changes don't reduce the quality of the code we have introduced Scrutinizer-CI to
provide feedback on code quality. After adding Scrutinizer-CI we also started to resolve
initial issues reported step by step and to increase the coverage of automated tests.

You can have a look at the results of the inspections and see the impact there:

https://scrutinizer-ci.com/g/TYPO3-Solr/ext-solr/statistics/

A couple pull requests have been merged to introduce Scrutinizer and to fix several issues:

Related PRs:

Our goal is to improve the code step by step and don't get worse.

Use of Compound Index Format

To avoid an error in Apache Solr with "too many open files", it is possible
to use the compound index format. Apache Solr is then writting to only one
index file instead of many. The downside however, is that the performance may
be slightly reduced but should not be significant for most projects.
We decided to change the default configuration here to use a more robust setting.
If you have very high performance requirements you can still change this behavior
by setting <useCompoundFile>false</useCompoundFile> in your solrconfig.xml.

Related PRs:

https://github.com/TYPO3-Solr/ext-solr/issues/695

Added Schema Field for Exact Matches

We've added a new data type "textExact" to the solr schema. Beside that copyFields have been added for the following fields:

titleExact
contentExact
tagsH1Exact
tagsH2H3Exact
tagsH4H5H6Exact
tagsInlineExact

Beside that this type is also available as dynamic fields with the following suffixes:

_textExactS
_textExactM

Related PRs:

https://github.com/TYPO3-Solr/ext-solr/pull/820

Username and Password for Solr Connection

Username and password can now be configured for the solr connection:

plugin.tx_solr.solr.username = username
plugin.tx_solr.solr.password = password

Related PRs:

https://github.com/TYPO3-Solr/ext-solr/pull/789

Timeout for Solr Connection

A timeout for the solr connection can now be configured:

plugin.tx_solr.solr.timeout = 20

Related PRs:

https://github.com/TYPO3-Solr/ext-solr/pull/798

Rendering Instruction for DateFormatting

The following rendering instruction can be used, when you want to format a date as option facet and store it as date or timestamp.

plugin.tx_solr.search.faceting.facets.created {
   field = created
   label = Created
   sortBy = alpha
   reverseOrder = 1
   renderingInstruction = TEXT
   renderingInstruction {
      field = optionValue
      postUserFunc = ApacheSolrForTypo3\Solr\Domain\Search\ResultSet\Facets\RenderingInstructions\FormatDate->format
   }
}

Related PRs:

https://github.com/TYPO3-Solr/ext-solr/pull/829

Breaking Changes

Updating from version 5.1.1 or earlier there are some breaking changes that
your need to keep in mind when updating.

Apache Solr 6 and Access Filter

Since version 6 Apache Solr comes with an embedded Jetty server which completely
changes the setup compared to Apache Solr 4.10. It is now required to install a
new instance of Apache Solr Server. This can be done with our install script for
development or you can use our Docker image to start a new Solr server as a container.
Both approaches are described in our documentation. The embedded Solr Jetty server also uses a new default port (8983) to serve connections.

Migration to Command Controllers for CLI

We are now using a command controller to update the Solr server connections.
Please use the following command to update your connections:

php ./typo3/cli_dispatch.phpsh extbase solr:updateConnections

Bugfixes

The following bugs have been fixed in this release.

Page is not added to queue when page_language_overlay record changed
https://github.com/TYPO3-Solr/ext-solr/pull/768
Use TypoScript configuration object for plugin baseWrap
https://github.com/TYPO3-Solr/ext-solr/pull/697
Fixed group by and statement in statistics
https://github.com/TYPO3-Solr/ext-solr/pull/722
Make definition of cookie in tx_solr_statistics compatible with ses_id in fe_sessions
https://github.com/TYPO3-Solr/ext-solr/pull/713
Fix recursive value resolution in SOLR_RELATION
https://github.com/TYPO3-Solr/ext-solr/pull/692
Use styled fields for the scheduler tasks
https://github.com/TYPO3-Solr/ext-solr/pull/672
Have index updated when using frontend editing
https://github.com/TYPO3-Solr/ext-solr/pull/648
Make suggest working when variants are used
https://github.com/TYPO3-Solr/ext-solr/pull/627

Outlook

In the next release (6.1) our focus will be to prepare support for TYPO3 CMS
version 8 LTS as well as possible. The next release (6.1) will also be the
last release for TYPO3 CMS version 7.6 LTS.

Contributors

Like always this release would not have been possible without the help from our
awesome community. Here are the contributors for this release.

(patches, comments, bug reports, reviews, ... in alphabetical order)

Anjey
Claus Due
Daniel Siepmann
Dominique Kreemers
Georg Ringer
Hendrik Putzek
Ingo Renner
Josef Glatz
Markus Friedrich
Markus Kasten
Michiel Roos
Olivier Dobberkau
Patrick Oberdorf
Peter Kraume
Philipp Gampe
Pierrick Caillon
Sascha Egerer
Thomas Hohn
Timo Hund
Tomas Norre Mikkelsen

Also a big thanks to our partners that have joined the EB2016 program:

Arrabiata Solutions GmbH & Co. KG
avonis
Bank CIC AG
Bitmotion GmbH
Citkomm services GmbH
cron IT
CS2 AG
Cosmoblonde GmbH
Daniz online markting
datenwerk innovationsagentur gmbh
Die Medialen GmbH
die_schnittsteller GmbH
E-magineurs
Fernando Hernáez Lopez
Future Connection AG
Gernot Leitgab
.hausformat
Hirsch & Wölfl GmbH
hs-digital GmbH
IHK Neubrandenburg
internezzo AG
jweiland.net
L.N. Schaffrath DigitalMedien GmbH
mehrwert intermediale kommunikation GmbH
netlogix GmbH & Co. KG
Pixel Ink
Pixelpark AG
pixolith GmbH & Co. KG
polargold GmbH
portrino GmbH
Q3i GmbH & Co. KG
raphael gmbh
RUAG Corporate Services AG
sitegeist media solutions GmbH
ST3 Elkartea
Star Finanz-Software Entwicklung und Vertriebs GmbH
Stefan Galinski Interndienstleistungen
Speedpartner GmbH
sunzinet AG
Systime A/S
SYZYGY Deutschland GmbH
tecsis GmbH
web-vision GmbH
websedit AG - Internetagentur
Webstobe GmbH
werkraum GmbH
WIND Internet
wow! solution
zdreicon AG

Thanks also to our partners who already singed up for a 2017 partnership (EB2017):

Amedick & Sommer Neue Medien GmbH
cron IT GmbH
b:dreizehn GmbH
Die Medialen GmbH
Leibniz Universität IT Services, Hannover
LOUIS INTERNET
polargold GmbH
Mercedes-AMG GmbH
Triplesense Reply GmbH
zdreicom AG

Thanks to everyone who helped in creating this release!

How to Get Involved

There are many ways to get involved with Apache Solr for TYPO3:

Submit bug reports and feature requests on GitHub
Ask or help or answer questions in our Slack channel
Provide patches through Pull Request or review and comment on existing Pull Requests
Go to www.typo3-solr.com or call dkd to sponsor the ongoing development of Apache Solr for TYPO3

Support us in 2017 by becoming an EB partner:

http://www.typo3-solr.com/en/contact/

or call:

+49 (0)69 - 2475218 0

ext-solr - 5.1.1 - Maintenance release

Published by timohund almost 8 years ago

Apache Solr for TYPO3 version 5.1.1 released

This release is a bugfix only release.

SOLR_RELATION: Recursive value resolution

By using the SOLR_RELATION option enableRecursiveValueResolution relations can be resolved recursive if the given foreignLabelField is a relation too. The bugfix resolves this issue and adapts the integration test to check if this feature is working.

Details: #690

ext-solr - 5.1.0 document variants / ux improvements / be statistics

Published by timohund about 8 years ago

Apache Solr for TYPO3 version 5.1.0 released

We're happy to announce the release of Apache Solr for TYPO3 (EXT:solr) version 5.1.0. This release ships a few bugfixes and smaller features

New in this Release

The focus of this release was to provide the new features from the codesprint and bugfixes from the issue tracker. Beside that, we've added a variants feature that could be used together with the upcomming solrfal release as one approach to avoid duplicated files in the search frontend.

Document Variants

This feature adds a new optional field variantId that is filled with type/uid and can be used for collapsing by default.

The following example shows the required typoscript configuration that is needed:

plugin.tx_solr.search {
    variants = 0
    variants {
        expand = 1
        variantField = variantId
        limit = 10
    }
}

The collapsing can be used to collapse on numeric and string fields, text fields are not supported for collapsing by Solr.

Note: You need to update your solrconfig and schema to use the new field variantId. When you include the TS Template "Everything on", variants are active. You need to reindex in this case to make sure that the field is filled correctly.

Details: https://github.com/TYPO3-Solr/ext-solr/pull/550

Improved Documentation

During the transition from forge to github, we've moved the rest of the documentation to our rst documentation.

Details: https://github.com/TYPO3-Solr/ext-solr/pull/547

Backend statistics

During the codesprint in Frankfurt a new statistics module was added for that backend that allows you to get some usefull insights
of your search installation.

Which terms are the most frequent search terms?
Which terms are frequently searched but deliver no result?

UX Improvements

During the codesprint several UX improvements in the backend module have been done:

Replace content element wizard icon with svg icon:

Replace content element wizard icon with svg icon

Detail: https://github.com/TYPO3-Solr/ext-solr/pull/581

Make init connections icon use SVG:

Adds new SVG icon for init connection

Details: https://github.com/TYPO3-Solr/ext-solr/pull/566

Backend module layout fixes

Makes sure everything is aligned properly
Removes some whitespace, giving the module content more room

Details: https://github.com/TYPO3-Solr/ext-solr/pull/575

Bugfix: absRefPrefix auto in cli mode with webroot different from PATH_site

When you are using absRefPrefix auto and index in cli mode and you webroot differs from PATH_site you have the possibility to configure a
webroot in the scheduler task to make absRefPrefix=auto work in this case

Details: https://github.com/TYPO3-Solr/ext-solr/pull/495

Bugfix: Keep selected site in scheduler task

When a site in the scheduler task was selected the selection could get lost.

Details: https://github.com/TYPO3-Solr/ext-solr/pull/557

Outlook

In the next release (6.0) we will focus on the integration of the latest Apache Solr Version (currently 6.1.0)

Contributors

Like always this release would not have been possible without the help from our
awesome community. These are the contributors for this release.

(patches, comments, bug reports, review, ... in alphabetical order)

Daniel Siepmann
Ingo Renner
Sascha Nowak
Steffen Ritter
Timo Hund
Thomas Hohn
Thomas Scholze

Also a big thanks to our partners that have joined the EB2016 program:

Bank CIC AG
Bitmotion GmbH
Citkomm services GmbH
CS2 AG
Cosmoblonde GmbH
Daniz online markting
datenwerk innovationsagentur gmbh
die_schnittsteller GmbH
E-magineurs
Fernando Hernáez Lopez
Future Connection AG
Gernot Leitgab
Hirsch & Wölfl GmbH
hs-digital GmbH
IHK Neubrandenburg
L.N. Schaffrath DigitalMedien GmbH
mehrwert intermediale kommunikation GmbH
netlogix GmbH & Co. KG
pixolith GmbH & Co. KG
Q3i GmbH & Co. KG
RUAG Corporate Services AG
ST3 Elkartea
Star Finanz-Software Entwicklung und Vertriebs GmbH
Stefan Galinski Interndienstleistungen
Systime A/S
SYZYGY Deutschland GmbH
web-vision GmbH
websedit AG - Internetagentur
Webstobe GmbH
WIND Internet

Thanks to everyone who helped in creating this release!

How to get involved

There are many ways to get involved with Apache Solr for TYPO3:

Submit bug reports, and feature requests on GitHub
Ask or help answering questions in our Slack channel
Provide patches through Pull Request or review and comment on existing Pull Requests
Go to www.typo3-solr.com or call dkd to sponsor the ongoing development of Apache Solr for TYPO3

ext-solr - 5.0.0 Fluid preparation / documentation

Published by timohund over 8 years ago

Apache Solr for TYPO3 version 5.0 released

We're happy to announce the release of Apache Solr for TYPO3 (EXT:solr) version 5.0.0. With this release we ship the requirements to use our new addon EXT:solrfluid, that allows you to render your search results with the fluid templating engine.

Beside the adaptions for solrfluid we mainly did bugfixes and cleanup in the code base. If you want to use solrfluid in your projects, you should signup a partnership with dkd (visit typo3-solr.com or call dkd +49 (0)69 - 247 52 18-0 for more information).

New in this Release

Preparing fluid support

Adding a SearchRequest object
Improving the SearchResultSetService

Dropping deprecated code

As announced in Version 4.0 the following methods have been removed:

Util::getTypoScriptObject please use TypoScriptConfiguration::getObjectByPath() instead.
Util::isValidTypoScriptPath please use TypoScriptConfiguration::isValidPath() instead.
Util::getTypoScriptValue please use TypoScriptConfiguration::getValueByPath() instead.
IndexQueue\Queue::getTableToIndexByIndexingConfigurationName please use TypoScriptConfiguration::getIndexQueueTableNameOrFallbackToConfigurationName instead.
IndexQueue\Queue::getTableIndexingConfigurations please use TypoScriptConfiguration::getEnabledIndexQueueConfigurationNames instead.
Plugin\PluginBase::search / PluginBase::getSearch / PluginBase::setSearch please use $pi->getSearchResultSetService()->getSearch() instead.
Plugin\Results\Results::getAdditionalFilters please use $pi->getSearchResultSetService()->getAdditionalFilters() instead.
Plugin\Results\Results::getNumberOfResultsPerPage use $pi->getSearchResultSetService()->getNumberOfResultsPerPage() instead.
Plugin\Results\Results::getAdditionalFilters please use $pi->getSearchResultSetService()->getAdditionalFilters() instead.
TypoScriptConfiguration::offsetGet / offsetExists / offsetSet please use TypoScriptConfiguration::getObjectByPath / isValidPath / getValueByPath instead. These functions have only been implemented for backwards compatibility in will be removed in 5.0

Dropping the class maps

Since EXT:solr 5.0 is only running on TYPO3 7.6 LTS and classmap files for backwards compatibility have been dropped. This also gives am small performance improvement for the current version.

Unify xliff files in one file per language

Because we want to use the labels in EXT:solr and EXT:solrfluid, and extbase requires to use one xliff file per language, we take the chance to streamline the language files into one file per language.

Performance improvement for TypoScriptConfiguration

Because TypoScriptConfiguration is used quite frequently, we did some performance improvements by optimizing the access to the underling array structure.

Add additionalWhereClause to SOLR_RELATION

You can now add an additionalWhereClause for SOLR_RELATION items.

Example:

plugin.tx_solr.index.queue {
    record = 1
    record {
        table = tx_extension_domain_model_record

        fields {
            title = title
            category_stringM = SOLR_RELATION
            category_stringM {
                localField = category
                multiValue = 1
                additionalWhereClause = pid=2
            }
        }
    }
}

See: https://github.com/TYPO3-Solr/ext-solr/issues/426

Show devLog entries as debug message or in the TYPO3 console

You can now show the written log messages as output of the debug console in the backend or debug messages in the frontent, when you enable the following setting:

plugin.tx_solr.logging.debugDevlogOutput = 1

NOTE: $GLOBALS['TYPO3_CONF_VARS']['SYS']['devIPmask'] needs to be configured and match.

RST Documentation

We've ported the typoscript reference from the forge wiki into an rst format. At the same time we've enhanced the documentation with chapters about:

Getting Started
The Backend
Logging
FAQ section

If you want to contribute and bring the documentation one step further feel free to proof-read or provide additional parts as a pull request.

Deprecations

Typo3Environment: The usage of ApacheSolrForTypo3\Solr\Typo3Environment is deprecated and should be removed

Outlook

In the next release (6.0) we will focus on our codesprint (11. to 13. august in frankfurt). Beside that we will focus
on issues in the issue tracker and general improvements of the codebase and documentation.

Contributors

Like always this release would not have been possible without the help from our
awesome community. These are the contributors for this release.

(patches, comments, bug reports, review, ... in alphabetical order)

Daniel Siepmann
Frans Saris
Gerald Spreer
Hendrik Nadler
Ingo Renner
Marc Bastian Heinrichs
Markus Friedrich
Olivier Dobberkau
Patrick Oberdorf
Peter Kraume
Sascha Löffler
Timo Hund

Also a big thanks to our partners that have joined the EB2016 program:

Bank CIC AG
CS2 AG
Cosmoblone GmbH
Daniz online markting
datenwerk innovationsagentur gmbh
die_schnittsteller GmbH
E-magineurs
Fernando Hernáez Lopez
Future Connection AG
Hirsch & Wölfl GmbH
hs-digital GmbH
L.N. Schaffrath DigitalMedien GmbH
pixolith GmbH & Co. KG
Q3i GmbH & Co. KG
RUAG Corporate Services AG
ST3 Elkartea
Star Finanz-Software Entwicklung und Vertriebs GmbH
Stefan Galinski Interndienstleistungen
Systime A/S
websedit AG - Internetagentur
Webstobe GmbH
web-vision GmbH

Thanks to everyone who helped in creating this release!

How to get involved

There are many ways to get involved with Apache Solr for TYPO3:

Submit bug reports, and feature requests on GitHub
Ask or help answering questions in our Slack channel
Provide patches through Pull Request or review and comment on existing Pull Requests
Go to www.typo3-solr.com or call dkd to sponsor the ongoing development of Apache Solr for TYPO3

ext-solr - 4.0.2 - Maintenance Release

Published by timohund over 8 years ago

Apache Solr for TYPO3 version 4.0.2 released

This is a bugfix and maintenance release that contains the following fixes:

[BUGFIX] Fix fallback path of defaultImagePrefix for indicator icon
[BUGFIX] Fix Runtime Deprecation Notice from flashMessageQueue (https://github.com/TYPO3-Solr/ext-solr/issues/363)
[BUGFIX] Parent plugin is not passed to SearchResultSetService (https://github.com/TYPO3-Solr/ext-solr/issues/366)
[BUGFIX] Fix indentation and typo in typoscript

Contributors

Like always this release would not have been possible without the help from our
awesome community. These are the contributors for this release.

(patches, comments, bug reports, review, ... in alphabetical order)

Gerald Spreer
Markus Friedrich
Peter Kraume
Timo Schmidt

ext-solr - 4.0.0 - Preparation for Fluid Support - 7.6 LTS only and TYPO3 8.0 / PHP 7.0 Preparation

Published by timohund over 8 years ago

Apache Solr for TYPO3 version 4.0 released

We're happy to announce the release of Apache Solr for TYPO3 (EXT:solr)
version 4.0.0. With this release we now support TYPO3 CMS versions 7.6LTS
together with Apache Solr version 4.10.
At the same time we also started making the extension work with TYPO3 8.

New in this Release

Support of TYPO3 7.6 LTS and TYPO3 8.0 (Dropping Support of 6.2 LTS)

To stay up-to-date with the TYPO3 core we decided to drop the support of 6.2 LTS
and support 7.6 LTS only. We also made sure that EXT:solr works
with TYPO3 8.0, this will be an ongoing effort until the LTS release of TYPO3 8.
Until then you may experience occasional bugs as we try to keep up with the
core's development.

Improve the Test Coverage for Fluid Integration and Refactoring

During the preparation for the upcoming fluid integration we used the chance to
refactor the frontend part of the extension.

What we did here:

Move the logic from the Result/Search and FrequentSearches plugins to service
classes in order to have the possibility to use them in different places
(e.g. other controllers)
Introduce a SearchResultSet and SearchResultSetService to improve the object
model of search results

TypoScriptConfiguration Object and Streamlining of Configuration usage

TypoScript configuration is used in many places and accessing it with an object
has some advantages:

Merging configuration with Flexforms and other sources is easier
We have a single point of access for configuration
We can move and remove isset()/is_array()/if..else logic to read and evaluate
configuration into this object and make the code that is using it more readable
Since the implementation is a cross cutting concern for the whole extension,
it can be used to improve the coverage of integration tests for all parts
By reading the annotations later it could be used to automatically generate
a TypoScript reference

During the preparation of the current release we implemented this
TypoScriptConfiguration object and replaced all parts in the scope of EXT:solr

Migration:

For backwards compatibility the TypoScriptConfiguration object can be used with
array access operators. If you want to read the configuration you can use the
speaking method name for a configuration path or use the methods
getValueByPath() or getObjectByPath().

PHP 7.0 ready

During the development we made sure that the code of EXT:solr works with PHP 7.0.

General Changes

Beside the major changes that have been mentioned before, there are a few minor
changes that might be interesting:

ExcludeContentByClass

You can now use a new TypoScript setting plugin.tx_solr.index.queue.pages.excludeContentByClass.

e.g.

plugin.tx_solr.index.queue.pages.excludeContentByClass = removeme

Removal of q.op Parameter from solrconfig.xml

Since solrconfig.xml contained a default value for the mm (MinimumMatch) and
q.op parameters and it does not make sense to have both at the same time for
eDismax we removed the q.op parameter from the default configuration to avoid
confusion.

Allow Indexing from Backend Module

To avoid switching from the backend module to scheduler and back, we added a
button to do a simple indexing run with just 10 documents.

Resolving Overlays of SOLR_RELATION objects

The SOLR_RELATION object is now taking an overlay into account when relations
are resolved. This allows you to resolve different relations from a translated
entity for an original entity.

Auto-Correct in Default Template

The goal of the search is to keep the visitor on the site and provide the best
results for them with the smallest possible interaction.

There was a feature in EXT:solr (searchUsingSpellCheckerSuggestion) that could
be used to automatically trigger a search using the spellchecker's suggestions
when a search with the original term did not retrieve any results. To simplify
the integration we added the needed markup to the default templates so that you
now just need to enable the feature and use it with the shipped default template.

How to use it?

plugin.tx_solr.search.spellchecking.searchUsingSpellCheckerSuggestion = 1

Use the shipped default templates or add the following snippet to your template (between
 and :

    <div class="tx-solr-search-suggestion_results">
        <!-- ###IF:###NO_RESULTS.HAS_SUGGESTION_RESULTS###|==|1### begin -->
        ###NO_RESULTS.SUGGESTION_RESULTS###
        <!-- ###IF:###NO_RESULTS.HAS_SUGGESTION_RESULTS###|==|1### end -->
    </div>

Dynamic Field Type for Spellchecking

For spellchecking we had no dynamic field type before. Since 4.0.0 we now ship
the dynamic field types *_textSpellS and *_textSpellM to allow you to
easily define fields for spell checking.

Usage of Styles and Modals from TYPO3 7 LTS

To keep the styling of the backend up-to-date and use the new JavaScript modals
we updated the backend module to use these new features.

Add Support of FastVectorHighlighter

Highlighting can be slow for large text documents - f.e. created when
indexing pdf documents - and slow down search queries. To help prevent this
issue we added support for Solr's FastVectorHighlighter

The FastVectorHighlighter will now be used by default if fragmentSize is set
to at least 18 (this is required by the FastVectorHighlighter to work).

Use Caching Framework in Util::getConfigurationFromPageId

Configuration is retrieved and evaluated many times during indexing. Thus it
made sense to use the TYPO3 caching framework to cache these expensive
operations and improve their performance.

Use Xliff as Translation Format

Translation files have been migrated to the xliff format. The EXT:solr team
would be happy if you contribute missing translations.

Resolve affected pages when "extendToSubpages" is set and "hidden" flag is changed

The Record Monitor is now able to evaluate the "hidden" flag on subpages when
the extendToSubpages page property is set or unset.

Add signal after IndexQueueWorkerTask::indexItems

You can now register for a new signal "afterIndexItems".

Bugfixes

Beside the improvements mentioned before many smaller bugs have been fixed in
this release as well.

Installation and Updating

This version of EXT:solr is based on the same Apache Solr Version (4.10) as the
last version so an update for the Solr server itself is not needed.

However, a few modifications to the schema and Solr configuration where made.
Please make sure to use the latest solrconfig.xml and schema versions.

You can always check TYPO3's system status report to see whether your setup
meets the requirements and is up-to-date to be used with EXT:solr.

Deprecations

The following functions and methods have been marked as deprecated and will be
removed in version 5.0

Util::getTypoScriptObject please use TypoScriptConfiguration::getObjectByPath() instead.
Util::isValidTypoScriptPath please use TypoScriptConfiguration::isValidPath() instead.
Util::getTypoScriptValue please use TypoScriptConfiguration::getValueByPath() instead.
IndexQueue\Queue::getTableToIndexByIndexingConfigurationName please use TypoScriptConfiguration::getIndexQueueTableNameOrFallbackToConfigurationName instead.
IndexQueue\Queue::getTableIndexingConfigurations please use TypoScriptConfiguration::getEnabledIndexQueueConfigurationNames instead.
Plugin\PluginBase::search / PluginBase::getSearch / PluginBase::setSearch please use $pi->getSearchResultSetService()->getSearch() instead.
Plugin\Results\Results::getAdditionalFilters please use $pi->getSearchResultSetService()->getAdditionalFilters() instead.
Plugin\Results\Results::getNumberOfResultsPerPage use $pi->getSearchResultSetService()->getNumberOfResultsPerPage() instead.
Plugin\Results\Results::getAdditionalFilters please use $pi->getSearchResultSetService()->getAdditionalFilters() instead.
TypoScriptConfiguration::offsetGet / offsetExists / offsetSet please use TypoScriptConfiguration::getObjectByPath / isValidPath / getValueByPath instead. These functions have only been implemented for backwards compatibility in will be removed in 5.0

Outlook

The next release (5.0) will focus on the needed refactorings to allow implementing
fluid template rendering. At the same time we will ship the first version of our
new extension "solrfluid" to our EAP partners.

Contributors

Like always this release would not have been possible without the help from our
awesome community. These are the contributors for this release.

(patches, comments, bug reports, review, ... in alphabetical order)

Dmitry Dulepov
Florian Seirer
Frank Nägler
Frans Saris
Ingo Pfennigstorf
Ingo Renner
Marc Bastian Heinrichs
Markus Friedrich
Markus Kobligk
Mickael Vanclooster
Olivier Dobberkau
Sascha Egerer
Timo Schmidt

Thanks to everyone who helped in creating this release!

How to get involved

There are many ways to get involved with Apache Solr for TYPO3:

Submit bug reports, and feature requests on GitHub
Ask or help answering questions in our Slack channel
Provide patches through Pull Request or review and comment on existing Pull Requests
Go to www.typo3-solr.com or call dkd to sponsor the ongoing development of Apache Solr for TYPO3

ext-solr - 3.1.2 - Maintenance Release

Published by timohund over 8 years ago

This release is a maintenance release for the 3.1 branch. Since EXT:solr 4.0.0 will require TYPO3 7.6 LTS or higher this release provides bugfixes for users on TYPO3 6.2 LTS

Provide needed adjustments to use replaced search content element:

https://github.com/TYPO3-Solr/ext-solr/issues/128

Index Inspector not working:

https://github.com/TYPO3-Solr/ext-solr/issues/241

JavaScript files get lost if concatenation and compression are enabled

https://github.com/TYPO3-Solr/ext-solr/issues/264

Solr doesn't support config.absRefPrefix = auto

https://github.com/TYPO3-Solr/ext-solr/issues/276

Re-Index after deleting a content element

https://github.com/TYPO3-Solr/ext-solr/issues/231

Support phrases inside a query string

https://github.com/TYPO3-Solr/ext-solr/issues/307

Thx to the following contributors for patches, reviews and backports:

Ingo Renner
Lorenz Ulrich
Markus Friedrich
Markus Kobligk
Timo Schmidt

ext-solr - 3.1.1 - Maintenance Release

Published by irnnr almost 9 years ago

Fixes an issue related to composer when installing an extension that depends on EXT:solr

ext-solr - 3.1.0 - Support for TYPO3 7.6LTS

Published by irnnr almost 9 years ago

Apache Solr for TYPO3 version 3.1 released

We're happy to announce the release of Apache Solr for TYPO3 (EXT:solr) version 3.1.0. With this release we now support TYPO3 CMS versions 6.2LTS and 7.6LTS together with Apache Solr version 4.10.

New in this Release

Support of TYPO3 7.6 LTS:

We added support for TYPO3 CMS 7.6LTS while still supporting version 6.2LTS to allow an easy upgrade. Support for TYPO3 version 4.5LTS has been dropped with this release. The next release will likely require at least TYPO3 7.6LTS.

On the code side we now use PSR-2 coding style like in TYPO3 7.6LTS. This way it is easy for contributors and developers to stick with a common coding style. For contributions PSR-2 style is also enforced through automatic checks now.

Overall we resolved over 40 issues and added almost 700 commits.

Apache Solr 4.10

The extension comes with an installer that installs Apache Tomcat 8.0.29 and Apache Solr 4.10.4. Please make sure to update to Apache Solr 4.10.4 and the new Solr schema and configuration provided by the extension to make sure the extension works as intended.

Manage Stopwords from the Backend

With EXT:solr 3.0 we introduced an all new backend module to manage the Index Queue, check index data, and manage synonyms. With this release we're adding a new sub module to allow editing stopwords.

Stopwords are usually used to discard common words when indexing. This can increase relevance of documents.

Introducing PHP Namespaces

Our complete codebase is now namespaced and uses root namespace "\ApacheSolrForTypo3\Solr" for all classes. We also added a class map to provide backwards compatibility. Nevertheless we suggest updating your extensions to use the namespaced class names if you use them.

Introducing Travis CI

For a long time we already had a small unit test suite. However, it was not kept up-to-date, tests weren't executed automatically and generally in a state that left room for improvement. Starting with this release we will focus on increasing test coverage and keeping them up-to-date.

The unit test suite is now executed automatically for each Pull Request through Travis CI (https://travis-ci.org/TYPO3-Solr/ext-solr). Currently we run tests against TYPO3 version 6.2 LTS, 7.6 LTS, and dev-master with the same PHP versions as TYPO3 CMS, PHP 5.3-5.6.

Additionally Travis CI also checks for PSR-2 compliance and will fail a PR in case the code does not fit that coding standard.

In case a Pull Request is rejected by Travis CI you can follow the link to the build and inspect its output to see what needs to be fixed.

General Changes

HTML escaping after retrieval from solr

The data ist now esapced right after the retrieval from Solr. In rare cases when you need to store HTML in Solr documents you can use the following configuration to mark these fields as trusted fields and skip the escaping:

plugin.tx_solr.search.trustedFields = my_first_html_field,my_second_html_field

Synonym handling (Lowercasing and Evaluation at Index- and Querytime)

Synonyms are now handled at query and index time. The advantage is, that when editing synonyms from the backend module those changes become effective immediatly.

Removed page browser dependency

As we were preparing to be compatible with TYPO3 7.6LTS we found that there is no compatible version of EXT:pagebrowse. We used that extension to provide the page browser in results listings. To become compatible with TYPO3 7.6LTS we now have integrated the page browser into EXT:solr itself. So if you are not using EXT:pagebrowse for anything else you can safely remove the extension from your installation.

Installation and Updating

To install EXT:solr version 3.1.0 you will need either TYPO3 6.2LTS or TYPO3 7.6LTS. On the Solr side we require Apache Solr 4.10.4, which requires Java 7.

When updating an existing installation to EXT:solr 3.1.0 please make sure to update to Apache Solr 4.10.4 including the new schema and configuration files. The extension comes with a script that will install a working setup for you automatically. The script can be found in EXT:solr/Resources/Install/.

In rare cases you may have to re-initialize the Solr connections. You can do so from TYPO3's clear cache menu in the top toolbar.
Because of the changes made to the schema you will need to re-index your site.

Make sure to check the system status report for any warnings or errors.

TypoScript Paths changed

During the migration to namespace we also had to change the TypoScript paths:

tx_solr_pi_results => tx_solr_PiResults_Results
tx_solr_pi_search => tx_solr_PiSearch_Search
tx_solr_pi_frequentsearches => tx_solr_PiFrequentSearches_FrequentSearches

If you're building custom TypoScript content objects referencing solr plugin configurations you should make to update these as well.

Outlook

With this release out the door we will focus on updating the add-on extensions like EXT:solrgrouping, EXT:tika, and EXT:solrfal for file indexing, these should be available soon, too.

The next release within the 3.x series will likely require at least TYPO3 7.6LTS and might as well arrive soon as there are no bigger changes planned yet besides dropping support for TYPO3 6.2LTS.

After that we will start working on the long-awaited move to Fluid as the template engine for version 4.0.

Contributors

Like always this release would not have been possible without the help from our awesome community. These are the contributors for this release.

(patches, comments, bug reports, review, ... in alphabetical order)

Alexander Stehlik
Andreas Allacher
Andreas Fernandez
Andreas Wolf
Daniel Siepmann
Dmitry Dulepov
Frank Nägler
Frans Saris
Gordon Brüggemann
Hans Höchtl
Heiko Hardt
Hendrik Nadler
Ingo Renner
Javn Wagner
Jens Jacobsen
Jigal van Hemert
Joschi Kuphal
Josef Florian Glatz
Kevin von Spiczak
Marc Bastian Heinrichs
Markus Friedrich
Markus Günther
Markus Sommer
Markus Kobligk
Maxime Lafontaine
Michael Knabe
Michiel Roos
M. Tillmann
Olivier Dobberkau
Peter Kraume
Phuong Doan
Romain Canon
Sascha Affolter
Sascha Egerer
Sascha Nowak
Sebastian Enders
Soren Malling
Stefan Galinski
Stefan Neufeind
Steffen Müller
Steffen Ritter
Thomas Heilmann
Thomas Janke
Timo Schmidt
Witali Rott
Thomas Heilmann

Thanks to everyone who helped in creating this release!

Introducing Timo Schmidt

Last but not least we would like to introduce Timo Schmidt. Timo recently joined dkd to work on Apache Solr for TYPO3 in support and development. If you've been active in our Slack channel or followed our GitHub commits you may have been in contact with Timo already. We're looking forward to working with Timo.

How to get involved

There are many ways to get involved with Apache Solr for TYPO3:

Submit bug reports, and feature requests on GitHub (https://github.com/TYPO3-Solr/ext-solr/issues)
Ask or help answering questions in our Slack channel: https://typo3.slack.com/messages/ext-solr/
Provide patches through Pull Request or review and comment on existing Pull Requests (https://github.com/TYPO3-Solr/ext-solr/pulls)
Go to http://www.typo3-solr.com/ or call dkd to sponsor the ongoing development of Apache Solr for TYPO3

ext-solr -

Published by irnnr almost 9 years ago

ext-solr - 3.0.2 - Maintenance Release, Security Bugfix

Published by irnnr about 9 years ago

In this release we are providing 10 bugfixes including one security related fix.

Security Bugfix

A non-persistent XSS issue is being fixed with this release. It is a low severity issue since the keepExistingParametersForNewSearches configuration option must be explicitly set to 1, it is 0 per default. Thanks to Hendrik Nadler for discovering the issue.

Updating

Since this is a patch-level release you can simply update the extension. No further changes are necessary.

Contributors

Thanks to all the contributors without whom this release would not have been possible. Thank you all! (no particular order)

Alexander Stehlik
Andreas Allacher
Romain Canon
Markus Kobligk

ext-solr - 3.0.1 - Maintenance Release

Published by irnnr over 9 years ago

In this release we are delivering about 75 changes including 55 bug fixes. The next release will be version 3.1 and will focus on optimized TYPO3 6.2+ support and drop support for TYPO3 4.5.

Notable Bug Fixes

Fixes related to editing synonyms
Fixed handling of expiration time/endtime of documents
Use GitHub for resource downloads during installation
Fallback to Apache archive servers when the version of Tomcat/Solr is not available on the mirrors anymore
Handling of invisible parents of translated records
Fixed rendering hierarchical facets in multi-lang setups

Updating

We try to avoid making changes to the Solr schema and solrconfig files for patch level release like this. However, this is not always possible. We had to make changes to the schema this time. Please check the status report to see whether you have to update your Solr configuration.

Contributors

Thanks to all the contributors without whom this release would not have been possible. Thank you all! (no particular order)

Andreas Allacher
Sascha Egerer
Witali Rott
Alexander Stehlik
Andreas Wolf
Hans Höchtl
Jigal van Hemert
Peter Kraume
Sascha Nowak
Stefan Neufeind
Maxime Lafontaine
Steffen Müller
Phuong Doan
Frank Nägler
Steffen Ritter
Heiko Hardt
Stefan Galinski
Marc Bastian Heinrichs
Markus Friedrich

Package Rankings

Top 1.08% on Packagist.org

Badges

Extracted from project README

Related Projects

ns_news_advancedsearch

News Advanced Search

14 Dec 2019 2

typo3-rector

Rector for TYPO3

04 Oct 2019 215

typo3

The TYPO3 Core - Enterprise Content Management System. Synchronized mirror of httpsPackages/TYPO3...

02 Mar 2011 1,008

lock_element

A TYPO3 extension to lock single pages or content records from being deleted

07 Mar 2018 1

ns_news_comments

News Comment

28 Jul 2018 4

typo3-warming

🚀 Extension for TYPO3 CMS that warms up Frontend caches based on an XML sitemap with multi-langua...

28 Apr 2021 15

tea

Example extension for unit testing and best practices.

12 Nov 2019 75

content_defender

Define allowed or denied content element types in your backend layouts

07 May 2017 80

t3ext-sphinx

TYPO3 Extension sphinx. Installs a full-fledged Sphinx environment within your TYPO3 website. Bui...

03 Jan 2018 0

typo3-solver

💡 Extension for TYPO3 CMS to extend TYPO3's exception handling with AI generated solutions

07 Feb 2023 26

ns_t3ai

T3AI: All-in-One TYPO3 AI Extension

09 Oct 2023 4

ext-feuserextrafields

TYPO3 extension that adds additional common fields to FE users

26 Mar 2020 1

ns_twitter

Twitter

26 Sep 2017 2

gkh_rss_import

TYPO3 extension to import an RSS feed and show the content on a page

18 Aug 2017 1

typo3-support

TYPO3 support component

03 Aug 2019 0

ext-solr

Apache Solr for TYPO3 version 7.0.2

Fix sorting counts in statistics module

Make plugin.tx_solr_PiSearch_Search available again

Add default typoscript view configuration

Wrong parameter value for grouping fields

Enable escaping in TranslateViewHelper and AbstractWidgetViewHelper

Thanks

Contributors

Sponsors

How to Get Involved

Apache Solr for TYPO3 version 7.0.1

Html tag of pagination is rendered in output

Contributors

How to Get Involved

Apache Solr for TYPO3 7.0.0

New in this release

FLUID Templating

Backend Modules Restructured

Add excludeValues for Facets

Allow to configure custom entry Template

Refactoring of Query API

Move FilterEncoder and FacetBuilder to Facet Package

Custom plugin namespace - Multiple Instances

Doctrine Migration

Add --rootpageid to CLI command

Respect Setting includeInAvailableFacets and includeInUsedFacets

Respect requirements facet setting with fluid

Respect setting searchUsingSpellCheckerSuggestion with fluid

Get rid of dependency to sys_domain record

Preparations for TYPO3 9

Bugfixes

Removed Code

Deprecated Code

Contributors

Outlook

How to Get Involved

Apache Solr for TYPO3 version 6.1.3 released

Optimize composer.json

Escape output of ScoreCalculation

Escape output of SiteSelector

Relation handler should handle pages overlays correctly

Contributors

How to Get Involved

Apache Solr for TYPO3 version 6.1.2 released

Missing parameter type in FrequentSearches::postInitializeTemplateEngine

Enable zero-configuration use of Docker image

Allow 'hide default translation of page' on root page

Language is lost for link in custom record with sys_language_mode = content_fallback

Contributors

How to Get Involved

Apache Solr for TYPO3 version 6.1.1 released

Ignore workspaces in RootPageResolver

Allow to limit the solr:updateConnections command to a rootpageid

Indexing records outside the rootline throws Exception

Tracking changes in records of other siteroots is not working as expected

Contributors

How to Get Involved

New in this Release

Compatible with TYPO3 8 LTS and PHP 7.1 ready

Backend Performance Improvements

Allow to use the closest configuration in the page tree

Add caching when record monitor is used

Add a global list of monitored tables

New Index Inspector

Allow to monitor records outside the siteroot

Use TYPO3 logging framework instead of devlog

Use ::class and shorten array syntax

Support partial matches with N-Gram and Edge N-Gram

Allow to disable siteHash check by using allowedSites = *

Update jQuery version

Fix scrutinizer issues

Add solr access filter plugin 2.0.0

Preparation for Doctrine migration

Allow self signed ssl certificates

Add cObject support for solr settings

Deprecated code

Breaking changes

Default variantId changed

Semantic of allowedSites changed