[FEATURE] Make statistics more dynamic

What this pr does

The statistics are hard-coded so far. It is now defined in Typoscript. If no values are defined, the previous values are set as the default value in the code to prevent a breaking change.

How to test

Simply add TypoScript and look at the statistics in the backend info module.

Hint

The documentation is adapted if everything fits in terms of content and the variable naming is also good enough.

Fixes: #3534

[BUGFIX] Fix handling of non existing pages on deletions

If a record's page or the site root is not available, exceptions will occur during garbage collection. This commit improves the handling of missing pages to fix this issue.

Resolves: #3500

!!![TASK] Introduce RootPageRecordNotFoundException

Introduces a specific exception for missing root page records.

If the page record for a root page check in RootPageResolver couldn't be found a generic InvalidArgumentException was thrown, this is now replaced with the specific RootPageRecordNotFoundException.

This is a breaking change as extensions might expect the InvalidArgumentException and try to handle issues on that basis, this extension have to be updated and consider the new exception.

Resolves: #3500

[TASK] Verify the record before accessing the pid

Verify that the record is not null before access the page id.

Resolves: #3535

[TASK] Handle Solr connection exception

Solr requests may fail due to server errors or faulty queries, thrown exceptions or just an invald status code indicate such errors.

This commit ensures that exceptions are handled and a valid response with a meaningful status code is returned. Handling is centralised in SolrService so that other components just have to deal with the status code.

Additionally the GarbageCollection is considering this status and is logging missing index update.

Resolves: #2903

[TASK] Rename misnamed util function getExceptionTime to getExecutionTime

[BUGFIX] Fix Solr repsonse handling during indexing

If a Solr response is not valid (=200) the index queue item should be marked as failed to prevent the indexer of being blocked. This commit fixes this issue by throwing an IndexingException which causes the IndexService to mark the item as failed.

Resolves: #3108

When translating, the HTML is not transformed cleanly. Originally planned for the & sign, another solution must be found.

When using the translate command and a file already exists, it is adjusted and in this process, already existing translations are overriden. See here:

Since it is quiet here now, I would close the issue. If something else comes up, feel free to open a new issue :-)

When translating to EN, there must be a mapping to EN-GB

The translation from EN to DE was not well possible. Some of the code was hard-coded.

https://aws.amazon.com/de/translate/

Is your feature request related to a problem? Please describe. We are in the backend in the statistics module with a core. At the moment, the days and the number of results of the statistics are firmly defined in the code. (30 days, 5 entries)

Describe the solution you'd like The settings should be controllable via TypoScript.

Additional context https://github.com/TYPO3-Solr/ext-solr/blob/main/Classes/Controller/Backend/Search/InfoModuleController.php#L127

In the course of this, the old ticket https://github.com/TYPO3-Solr/ext-solr/issues/1583 could also be addressed.

Target versions 11.5.x / 12

As we need this with a client, we will take over the implementation in the coming period.

[TASK] Use TYPO3 IpAnonymizationUtility

Related #3262

!!![TASK] Pass pages to preAddModifyDocuments hook

Now the preAddModifyDocuments hook is called for pages as well. Also the indexPagePostProcessPageDocument hook is deprecated and superseeded by:

 $GLOBALS['TYPO3_CONF_VARS']['EXTCONF']['solr']['IndexQueueIndexer']
   ['preAddModifyDocuments']

Fixes: #2285 Ports: #3076

[BUGFIX] Fix array key access in ext_getSetup

Reading nested TypoScript will no longer log a warning when the value can not be accessed. In this case, the second value in the array returned in TypoScript::ext_getSetup will be an empty string. However, the second value is not used by Ext:solr anymore.

This also fixes an issue with PHP 8 where such warning would cause the indexing to fail, when the method is used inside of an indexer.

Fixes: #3359

[TASK] Introduce index queue type setting

Queue types shouldn't be restricted to internal data, which is already prepared in some classes. As index queue setting 'table' suggests that a local table is expected, this is replaced with a new setting 'type'.

queue.[indexConfig].table is now deprecated and will be removed in v13, 'type' should be used instead.

Resolves: #3365

[TASK] Indexing configuration icon fallback

Index queue module uses the registered record icon for each indexing configuration, if no valid icon is found or no local table is used, the default fallback icon is used and indicates an error. This commit implements an icon check and a default icon that doesn't imply an error.

Resolves: #3368

[BUGFIX] Do not index missing fields

In case the data used for a Solr field is not present in the data (e.g. if it is conditionally set via a custom indexer), the field will no longer be created.

Previously the data was accessed anyways, resulting in a PHP warning which would abort the indexing in PHP 8.

Now a check has been implemented to verify that the accessed variable actually exists in configuration and data.

Fixes: #3366

[TASK] Do not index language with unconfigured core

Relates: #3362

[BUGFIX] Make API eID script compatible with TYPO3 v11.5

Ports: #3350

[TASK] Refactor API eID script

Relates: #3350

[TASK] Prepare GitHub-Actions for task/3376-TYPO3_12_compatibility branch

The GitHub Actions must run if pull-request against task/3376-TYPO3_12_compatibility is created.

Note: The task/3376-TYPO3_12_compatibility must be used for pull-request against main branch. The task/3376-TYPO3_12_compatibility must be used for non-stable pre-releases for TYPO3 12

Fixes: #3382 Relates: #3376

[BUGFIX] Type-hinting for SiteUtility::getConnectionProperty()

SiteUtility::getConnectionProperty() method must handle mixed types.

Fixes: #3394 Ports: #3396

[TASK] Introduce generic EXT:solr exception

To simplify the exception handling a generic Apache Solr for TYPO3 exception is introduced, this will be the base exception thrown by Solr extensions.

[TASK] Remove unused method ConnectionManager->buildConnectionLabel

Method ConnectionManager->buildConnectionLabel was used to build a human-readable connection label, as it's unused since version v11.0.0 it's no removed

[BUGFIX] Fix frontend Solr connection initialization

Solr plugins are initializing Solr connections for all available languages, this causes wrong language initializations in the PageRenderer, as all created TypoScriptFrontendController instances will overwrite the language setting.

By allowing to fetch the Solr configuration by TYPO3 site and a specific language this issue is solved and the initialization overhead is reduced.

Resolves: #3423

[ACTIONS:2022.12.22:P:main] Use fixed typo3/coding-standards 0.6.x < 0.7.0 for TYPO3 11.5

composer constraint >=0.5.0 doesn't fit current needs for different PHP versions. To avoid different rules for PHP 7.4 vs 8.0+, the constraint is set to use typo3/coding-standards 0.6.x only.

Todo: Extract coding standards test from cibuild and run it one time only directly via actions job. Alternativelly, run it for specific version only.

Note: This port will be overidden via task/3376-TYPO3_12_compatibility properly.

Ports: #3429

[TASK:Security:P:12.0.x] Update jQuery and its plugin libs

This change contains JS libs updates:

• Resources/Public/JavaScript/JQuery/jquery-ui.min.js to v1.13.2 Source: https://jqueryui.com/download/#!version=1.13.2&components=110000110001000000100010110010000000000000000000
• Resources/Public/JavaScript/JQuery/jquery.autocomplete.min.js to v1.4.11 Source: https://github.com/devbridge/jQuery-Autocomplete/blob/v1.4.11/dist/jquery.autocomplete.min.js
• Resources/Public/JavaScript/JQuery/jquery.min.js to v3.6.3 Source: https://code.jquery.com/jquery-3.6.3.min.js
• Resources/Public/JavaScript/JQuery/jquery.URI.min.js and Resources/Public/JavaScript/JQuery/URI.min.js to v1.19.11 merged together via build tool, see Source. Source: http://medialize.github.io/URI.js/build.html

Fixes: #3379, #3419 Ports: #3428

[BUGFIX] Proper check for config.index_enable

Not initialized variable leads to exception using PHP 8+ in

https://github.com/TYPO3-Solr/ext-solr/blob/bfe1599a7533ed8aff0060ab932067ecd32dacad/Classes/IndexQueue/FrontendHelper/PageIndexer.php#L256

Fixes: #3403

[BUGFIX] Typecast $timestamp to int in TimestampToUtcIsoDate

Due to refactoring in FormatService, the parameter for timestampToUtcIso has been defined as int or null. The function is however used in TimestampToUtcIsoDate with the direct value of the field, which is a string. This change ensures, that an integer value is passed.

Fixes: #3406

[BUGFIX] prevent undefined array key warning if filter is empty

An empty filter in query string of URL tx_solr[filter][]= leads to PHP 8+ Warninng:

PHP Warning: Undefined array key 1 in /var/www/html/web/typo3conf/ext/solr/Classes/Query/Modifier/Faceting.php line 241

See: https://github.com/TYPO3-Solr/ext-solr/blob/bfe1599a7533ed8aff0060ab932067ecd32dacad/Classes/Query/Modifier/Faceting.php#L241

Closes: #3398

[BUGFIX:P:12.0] Fix php warning undefined array key no_search_sub_entries

To avoid php warning for undefined array key, check if key is set in $page array.

Fixes #3380 Ports: #3381

[TASK] Remove valid videos from mailing

• Screenshots
• Show the relationship between the tasks
• Separation between integrator and dev
• Youtube -> YouTube

Update README.md

Update README.md

[TASK] Update current extension status

A backend module would help to keep track of the project. In this way, you could also query individual videos in order to avoid the caching issue.

• Listing videos (two tabs and with pagination)
• Video Actions: Refresh video status, edit metadata, Open Public url

• required Options must be checked
• Improve explanations
• Set Youtube,Vimeo as default

• Screenshots
• Show the relationship between the tasks
• Separation between integrator and dev
• Youtube -> YouTube

Hi! I tested a bit with the extension. This also works in version 11.5. I only had to change something in the Composer JSON, so it was relatively easy.

There was also a small bug/change with DSN. I only had to change one line:

https://github.com/different-technology/mfa_sms/blob/master/Classes/Sms/TransportFactory.php#L46

$dsnObject = Dsn::fromString($dsn); to $dsnObject = new Dsn($dsn);

When Autoplay is activated, muted should automatically be set to true.

see https://developer.chrome.com/blog/autoplay/

https://github.com/WapplerSystems/videos/blob/release/v11/Resources/Private/Partials/fluid_styled_content/Media/Rendering/Video.html https://github.com/WapplerSystems/videos/blob/release/v11/Resources/Private/Partials/fluid_styled_content/Media/Type/Video.html

VHS is used. Either the dependency would have to be added to the composer or the templates would have to be adapted.