MatthiasKuehneEllerhold
Followers
7
Following
13

Events

issue comment
Malformed state response from server

Ive now upgraded to PHP8.0 (from 7.4) and installed php8.0-smbclient (instead of using the the smbclient cli backend). Version 3.5.4 now works correctly. @NoFrust You're doing exactly that: libsmbclient instead of cli smbclient paired with a recent PHP version (presumably).

Created at 2 weeks ago
issue comment
Malformed state response from server

Same error with 3.5.4!

Created at 2 weeks ago
issue comment
No filesizes on MacOS after searching

See #20 . This is a bug in Samba and cant be fixed in the indexer.

Created at 3 weeks ago
No filesizes on MacOS after searching

When searching a filename or a part of a filename, the finder only shows the found filenames and the dates but no filesize. Is this limited by fs2es-indexer or by samba?

Created at 3 weeks ago

Update Fs2EsIndexer.py

Add a surrogatepass to encode, in case paths contain UTF surrogate characters, which is apparently possible somehow on some filesystems.

Merge pull request #23 from kode54/path-surrogate-fix

Add errors=surrogatepass to encode

CHANGELOG

Merge remote-tracking branch 'origin/develop' into eru-poetry

Created at 2 months ago
issue comment
Crashes out if a file contains UTF-16 surrogates

Thanks for your report and the PR!

Created at 2 months ago
Crashes out if a file contains UTF-16 surrogates

It crashes if a UTF-16 encoded file contains surrogates:

UnicodeEncodeError: 'utf-8' codec can't encode character '\udcf6' in position 86: surrogates not allowed

It should support these, since Windows created UTF-16 files will contain them.

Created at 2 months ago
issue comment
Crashes out if a file contains UTF-16 surrogates

Fixed in https://github.com/Ellerhold/fs2es-indexer/pull/23, published as 0.4.2

Created at 2 months ago
issue comment
Update Fs2EsIndexer.py

Thanks! Published as 0.4.2 !

Created at 2 months ago
MatthiasKuehneEllerhold create tag 0.4.2
Created at 2 months ago

Update Fs2EsIndexer.py

Add a surrogatepass to encode, in case paths contain UTF surrogate characters, which is apparently possible somehow on some filesystems.

Merge pull request #23 from kode54/path-surrogate-fix

Add errors=surrogatepass to encode

CHANGELOG

Created at 2 months ago

Update Fs2EsIndexer.py

Add a surrogatepass to encode, in case paths contain UTF surrogate characters, which is apparently possible somehow on some filesystems.

Merge pull request #23 from kode54/path-surrogate-fix

Add errors=surrogatepass to encode

Created at 2 months ago
pull request closed
Update Fs2EsIndexer.py

Add a surrogatepass to encode, in case paths contain UTF surrogate characters, which is apparently possible somehow on some filesystems.

Created at 2 months ago
a few errors

Hi, first of all thank you very much for your work! I have two troubles:

  • when I search I get the following error
2022-03-11 13:07:25 Failed to search for documents of index "files" at elasticsearch "http://localhost:9200": search() got an unexpected keyword argument 'query'

with command

fs2es-indexer search --log-level-es DEBUG --search-path /home/rainbow --search-file "AR9280.pdf"
  • during index
2022-03-11 12:42:31 Reading config file "/etc/fs2es-indexer/config.yml"
2022-03-11 12:42:31 - Creating index "files" ...
2022-03-11 12:42:32 - Index "files" successfully created
2022-03-11 12:42:32 - Indexing of files and directories in "/data/media" ...
Traceback (most recent call last):
  File "/usr/bin/fs2es-indexer", line 4, in <module>
    __import__('pkg_resources').run_script('fs2es-indexer==0.3.3', 'fs2es-indexer')
  File "/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 651, in run_script
    self.require(requires)[0].run_script(script_name, ns)
  File "/usr/lib/python3/dist-packages/pkg_resources/__init__.py", line 1455, in run_script
    exec(script_code, namespace, namespace)
  File "/usr/lib/python3/dist-packages/fs2es_indexer-0.3.3-py3.9.egg/EGG-INFO/scripts/fs2es-indexer", line 71, in <module>
  File "/usr/lib/python3/dist-packages/fs2es_indexer-0.3.3-py3.9.egg/fs2es_indexer/Fs2EsIndexer.py", line 186, in index_directories
  File "/usr/lib/python3/dist-packages/fs2es_indexer-0.3.3-py3.9.egg/fs2es_indexer/Fs2EsIndexer.py", line 57, in map_path_to_es_document
  File "/usr/lib/python3.9/genericpath.py", line 50, in getsize
    return os.stat(filename).st_size
FileNotFoundError: [Errno 2] No such file or directory: '/data/media/software/mac/Labels & Addresses.app/Contents/Frameworks/SBJson.framework/Resources'

and the file is a link

'/data/media/software/mac/Labels & Addresses.app/Contents/Frameworks/SBJson.framework/Resources' -> Versions/Current/Resources

should be checked if it doesn't exist.

Environment:

  • Debian 11.2
  • fs2es-indexer 99aa62b452432dad65f8c58e25ffb0abf7d2b6f4
  • elasticsearch 7.17.1

All with default configuration.

thank you

Created at 3 months ago
Finder not showing results.

Hey, I am using Elasticsearch 8.1.2 with the fs3es-crawler on Ubuntu 20.4 for indexing SMB Shares. I am able to run the indexer and daemon, and i am also able to search with fs2es-indexer search --search-path /srv/samba --search-term

But when i try to search in Finder for a file on the share, it displays 0 results, while SMB logs shows that the files are found. Do you have maybe an idea about this ? Thanks.

Created at 3 months ago
issue comment
Finder not showing results.

Sorry, I can't help you there. Try asking the samba mailing list for problem between Samba and ES. Seems like it is not a problem with the indexer.

If you manage to fix it, please post the solution here so I can add it to the README.

Created at 3 months ago