cybrneko/searxng-nekosearch
1
0
Fork 0
Code Issues Pull Requests Actions 1 Activity
3,855 Commits 6 Branches 0 Tags
5f92dfcdbe6e6db9781c2b82a2bd8ba4914b89e6
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Alexandre Flament 73c86f9bf2 [mod] checker: disable by default 2021-01-19 21:44:48 +01:00
Alexandre Flament 3b7b852aa8 [fix] checker: minor fix about language detection 2021-01-19 21:29:31 +01:00
Alexandre Flament aa887eb375 [mod] checker : replace pycld3 by langdetect 
pycld3 requires the native library cld3
langdetect is a pure python package
 2021-01-19 21:26:04 +01:00
Alexandre Flament 0495e15df4 Merge pull request #2476 from dalf/fix-error-recording-and-checker 
Fix error recording and checker
 2021-01-18 08:29:25 +01:00
Alexandre Flament 67a1aab0d5 [fix] /stats/checker : remove the timestamp field when the checker is disabled 2021-01-18 08:19:53 +01:00
Alexandre Flament d473407ec9 [fix] checker: fix engine statistics 
Without this commit, the URL /stats/errors shows percentage above 100% after the checker has run.
 2021-01-18 08:19:44 +01:00
Alexandre Flament ca76f3119a [fix] error_recorder: record code and lineno about the engine 
since the PR #2225 , code and lineno were sometimes meaningless
see /stats/errors
 2021-01-17 16:25:11 +01:00
Alexandre Flament 80d7411f2c Merge pull request #2452 from kvch/add-wilby-engine 
Add wiby.me engine
 2021-01-16 22:36:31 +01:00
Alexandre Flament b405646749 Merge pull request #2451 from mrwormo/invidious-engine 
[Fix] Invidious Engine
 2021-01-16 19:25:45 +01:00
Alexandre Flament 709dd960f1 Merge pull request #2473 from return42/fix-setup.py 
[fix] setup.py requires pyyaml installed
 2021-01-16 19:05:36 +01:00
Alexandre Flament 1d13ad8452 Merge pull request #2460 from dalf/engine-about 
[enh] engines: add about variable
 2021-01-16 19:05:17 +01:00
Alexandre Flament a4dcfa025c [enh] engines: add about variable 
move meta information from comment to the about variable
so the preferences, the documentation can show these information
 2021-01-14 20:57:17 +01:00
Alexandre Flament 5a511f0d62 [fix] CI: fix docker push 2021-01-14 20:35:10 +01:00
Alexandre Flament 824fe40a28 Merge pull request #2467 from dalf/fix-ci 
[fix] github actions: use ubuntu-20.04 instead of ubuntu-latest
 2021-01-14 17:14:59 +01:00
Alexandre Flament 38090daa29 [fix] github actions: use ubuntu-20.04 instead of ubuntu-latest 2021-01-14 16:49:17 +01:00
Alexandre Flament 484dc99580 Merge pull request #2419 from dalf/checker 
[enh] add checker
 2021-01-13 15:46:48 +01:00
Alexandre Flament 912c7e975c [fix] checker: don't run the checker when uwsgi is not properly configured 
Before this commit, even with the scheduler disabled, the checker was running
at least once for each uwsgi worker.
 2021-01-13 14:07:39 +01:00
Alexandre Flament 7f0c508598 [fix] checker: fix typo unknown instead of unknow 2021-01-12 11:47:17 +01:00
Alexandre Flament a0c8b413a6 [mod] searx.shared: minor tweaks 
searx.shared.shared_abstract.SharedDict inherit from abc.ABC
searx.shared.shared_uwsgi.schedule can schedule multiple functions without issue
 2021-01-12 11:47:17 +01:00
Alexandre Flament 87bafbc32b [mod] checker: add status and timestamp to the result 
for each engine: replace status by success
 2021-01-12 11:47:17 +01:00
Alexandre Flament f3e1bd308f [mod] checker: minor adjustements on the default tests 
the query "time" is convinient because most of the search engine will return some results,
but some engines in the general category will return documentation about the HTML tags <time> or <input type="time">
 2021-01-12 11:47:17 +01:00
Alexandre Flament 45bfab77d0 |mod] checker: improve searx-checker command line 
* output is unbuffered
* verbose mode describe more precisly the errrors
 2021-01-12 11:47:17 +01:00
Alexandre Flament 3a9f513521 [enh] checker: background check 
See settings.yml for the options
SIGUSR1 signal starts the checker.
The result is available at /stats/checker
 2021-01-12 11:47:17 +01:00
Alexandre Flament 6e2872f436 [enh] add searx.shared 
shared dictionary between the workers (UWSGI or werkzeug)
scheduler: run a task once every x seconds (UWSGI or werkzeug)
 2021-01-12 11:47:17 +01:00
Alexandre Flament ca0889d488 [enh] checker: wikidata & ddd: add specific tests 2021-01-12 11:47:17 +01:00
Alexandre Flament 16a889dd8f [enh] checker: add rosebud test 2021-01-12 11:47:17 +01:00
Alexandre Flament 8cbc9f2d58 [enh] add checker 2021-01-12 11:47:17 +01:00
Alexandre Flament f7e11fd722 Merge pull request #2459 from dalf/update-python 
Update python
 2021-01-12 11:02:58 +01:00
Alexandre Flament 9c55d772e9 Merge pull request #2408 from return42/rm-brand-make 
[mod] move brand options from Makefile to settings.yml
 2021-01-12 10:52:42 +01:00
Alexandre Flament 8989bc76cb [mod] remove pyopenssl dependency 
requests[security] is now deprecated since version 2.25.0
 2021-01-12 09:56:56 +01:00
Alexandre Flament d54034a5e6 [mod] add Python 3.9 support 2021-01-12 09:53:26 +01:00
Alexandre Flament f5c3cb7afa [mod] drop Python 3.5 support 2021-01-12 09:45:16 +01:00
Alexandre Flament 8d0312d014 Merge pull request #2458 from MarcAbonce/hide-links-mobile2 
Hide links panel in mobile screens
 2021-01-12 08:27:24 +01:00
Alexandre Flament e7ecf3ab42 Merge pull request #2457 from archiecodes/master 
Fixed typo
 2021-01-12 08:23:28 +01:00
Alexandre Flament 424e6abc7e [mod] settings.yml: move brand settings to a dedicated section 2021-01-11 22:59:52 +01:00
Alexandre Flament d5882147e0 [fix] utils/build_env.py: make sure to always use searx/settings.yml 
ignore SEARX_SETTINGS_PATH
 2021-01-11 22:59:35 +01:00
Alexandre Flament c2646df496 Merge pull request #2454 from MarcAbonce/fix-empty-lang-bang 
Fix empty colon in query from selecting Chinese
 2021-01-10 11:01:32 +01:00
Alexandre Flament 485380cd3e Merge pull request #2447 from unixfox/issue-template-notice 
add notice for the issue templates
 2021-01-08 09:30:23 +01:00
Alexandre Flament 5225c4f253 Merge pull request #2448 from return42/fix-1998 
[fix] Library Genesis links shifted by 1 #1998
 2021-01-08 09:29:36 +01:00
Alexandre Flament 14a395a671 Merge pull request #2445 from searx/unixfox-patch-1 
Remove voat due to its shutdown
 2021-01-06 14:06:49 +01:00
Alexandre Flament fb4e6080ed Merge pull request #2428 from dalf/update-dependencies 
[upd] update Python dependencies
 2021-01-05 16:42:51 +01:00
Alexandre Flament 5b58f6a7f8 Merge pull request #2435 from return42/fix-lxc-env 
[LXC] replace ubu1910 image by ubu2010 image
 2021-01-05 16:41:13 +01:00
Alexandre Flament 54e69d0367 [upd] update dependencies 
minor change in the oscar theme becase the last version of jinja2
respect more carefully the spaces in the templates
 2020-12-28 09:04:39 +01:00
Alexandre Flament 5fb9a5c7c1 Merge pull request #2411 from dalf/update-secret-key-check 
Update secret key check
 2020-12-27 18:04:53 +01:00
Alexandre Flament 5840499bfb Merge pull request #2423 from return42/mod1-boilerplate 
Speed up PyLint & revert obsolete CSS issue
 2020-12-27 14:12:56 +01:00
Alexandre Flament 568b9465e9 [mod] check secret_key when searx.webapp is imported 
Without this commit the module searx checks the secret_key value.

With this commit, make docs, utils/standalone_searx.py,
utils/fetch_firefox_version.py works without SEARX_DEBUG=1

For reference see https://github.com/searx/searx/pull/2386
 2020-12-27 10:30:20 +01:00
Alexandre Flament eb1b5289d5 [mod] documentation: change the jinja context doesn't depend on searx.webapp 
Before this commit, in the documentation, the jinja context is 'webapp' and contains
the global variable in the searx.webapp module.

This commit changes this to include only the mandatory variables to build the
documentation.
 2020-12-27 10:00:35 +01:00
Alexandre Flament 1ba53e6129 Merge pull request #2420 from return42/fix-sphinx-book-targets 
fix makefile `books/{name}.*` targets and add documentation about these targets
 2020-12-27 09:47:49 +01:00
Alexandre Flament 1956ab4b50 Merge pull request #2412 from dalf/update-buildenv 
[fix] update buildenv
 2020-12-27 08:31:23 +01:00
Alexandre Flament 48b4af1e08 Merge pull request #2421 from return42/mod-pyenvinstall 
[perf] optimize creation of the virtualenv & pyenvinstal targets
 2020-12-27 08:27:52 +01:00
Alexandre Flament 2fc2d17a27 Merge pull request #2418 from return42/fix-pyenv-install 
[fix] makefile.python: remove duplicate pyenv-(un)install targets
 2020-12-24 10:23:09 +01:00
Alexandre Flament d129186212 Merge pull request #2417 from return42/fix-seetings-template 
[fix] use SEARX_SETTINGS_TEMPLATE from .config environment
 2020-12-24 10:00:29 +01:00
Alexandre Flament c2aaf6f992 Merge pull request #2415 from return42/upd-useragent 
update useragents
 2020-12-22 16:02:36 +01:00
Alexandre Flament db5b060455 [fix] update buildenv 
CONTACT_URL is unset in Makefile, but searx/brand.py and
utils/brand.env are not updated.

This commit fixes this issue.
 2020-12-21 10:55:28 +01:00
Alexandre Flament 59217bb5be Merge pull request #2397 from dalf/update-ci 
updates for Python 3.9 / update CI
 2020-12-20 09:51:24 +01:00
Alexandre Flament 3f8ebf70b1 [fix] pylint: use "raise ... from ..." 2020-12-20 09:46:53 +01:00
Alexandre Flament eb33ae6893 [fix] Python 3.9: use html.unescape instead of HTMLParser.unescape 2020-12-20 09:46:53 +01:00
Alexandre Flament 6402fb0b9a [enh] CI: use actions/cache@v2 for Python dependencies 2020-12-20 09:42:37 +01:00
Alexandre Flament 04447f8c1a Merge pull request #2398 from dalf/mod-search-query 
Mod search query
 2020-12-20 09:32:54 +01:00
Alexandre Flament 35feb00a5b Merge pull request #2405 from dalf/no-emojis 
[mod] remove emojis from source code
 2020-12-20 09:32:26 +01:00
Alexandre Flament 72d2bb2289 Merge pull request #2399 from return42/fix-lxc 
[fix] determine path to makefile.lxc in a LXC
 2020-12-20 09:32:00 +01:00
Alexandre Flament 32e4eab336 Merge pull request #2401 from return42/drop-virtualenv-cmd 
[mod] remove obsolete virtualenv command
 2020-12-20 09:29:53 +01:00
Alexandre Flament f4983e7415 [mod] remove emojis from source code 2020-12-20 08:58:57 +01:00
Alexandre Flament eda8934f15 [mod] searx.search.EngineRef: remove from_bang parameter 
from_bang is True when the user query contains a bang.
In this case the category is also set to 'none'.

from_bang only usage was in searx.webadapter.parse_specific :
if from_bang is True, then the EngineRef category is ignored and force to 'none'.

This commit also removes the searx.webadapter.parse_sepecific function.
 2020-12-18 12:29:48 +01:00
Alexandre Flament 995ba2f406 [mod] searx.search.SearchQuery: remove categories parameter 
The categories parameter is useless in the constructor:
it is always the categories from the EngineRef.

The categories becomes a property.
 2020-12-18 12:29:48 +01:00
Alexandre Flament 14c7cc0e11 [mod] Makefile: make CONTACT_URL optional 2020-12-18 09:54:03 +01:00
Alexandre Flament 5c6a5407a0 [fix] fix of PR #2225 2020-12-17 16:49:48 +01:00
Alexandre Flament 9b27935f71 Merge pull request #2225 from dalf/processors 
Processors
 2020-12-17 11:49:43 +01:00
Alexandre Flament 02fc4147ce [mod] dictzone, translated, currency_convert: use engine_type online_curency and online_dictionnary 2020-12-17 11:39:36 +01:00
Alexandre Flament 7ec8bc3ea7 [mod] split searx.search into different processors 
see searx.search.processors.abstract.EngineProcessor

First the method searx call the get_params method.

If the return value is not None, then the searx call the method search.
 2020-12-17 11:39:36 +01:00
Alexandre Flament c0cc01e936 [mod] searx.search: search_multiple_requests is a method of Search class 2020-12-17 11:39:36 +01:00
Alexandre Flament 3b87efb3db [mod] move seax/search.py to searx/search/__init__.py 2020-12-17 11:39:36 +01:00
Alexandre Flament 13a2b1a44d Merge pull request #2344 from dalf/mod-themes 
[mod] themes: remove legacy, courgette and pix-art themes
 2020-12-17 11:38:15 +01:00
Alexandre Flament 9bc1856e2b [mod] themes: remove legacy, courgette and pix-art themes 2020-12-17 11:33:28 +01:00
Alexandre Flament 88660fde90 Merge pull request #2396 from lucky13820/patch-1 
Fix the StartPage result title is showing the url
 2020-12-17 08:23:34 +01:00
Alexandre Flament 36235dfde2 Merge pull request #2387 from return42/issue-2383 
[themes] add hyperlink to searx instances list in error message
 2020-12-17 08:20:20 +01:00
Alexandre Flament 002d53abf3 Merge pull request #2389 from searx/update-changelog 
prepare release 0.18.0: update CHANGELOG.rst
 2020-12-14 19:12:12 +01:00
Alexandre Flament 39ac81478c prepare release 0.18.0 2020-12-14 19:03:09 +01:00
Alexandre Flament 7865566338 Merge pull request #2384 from return42/improve-doc 
Improve doc of the installation skripts
 2020-12-14 18:22:12 +01:00
Alexandre Flament d110624df0 Merge pull request #2388 from searx/update-authors 
update AUTHORS.rst with new contributors
 2020-12-14 18:18:23 +01:00
Alexandre Flament 17fdfb6759 Merge pull request #2380 from return42/dev-quickstart 
[doc] update developer quickstart guide
 2020-12-14 18:11:53 +01:00
Alexandre Flament b167ad67a0 update AUTHORS.rst with new contributors 2020-12-14 18:01:42 +01:00
Alexandre Flament 292b73a3fc Merge pull request #2385 from joshu9h/patch-1 
[Fix] Startpage
 2020-12-14 17:56:48 +01:00
Alexandre Flament 36600118fb Merge pull request #2372 from dalf/remove-broken-engines 
[remove] remove searchcode_doc and twitter
 2020-12-13 17:11:05 +01:00
Alexandre Flament 3c4a9c1188 Merge pull request #2358 from dalf/fix-command 
[fix] command engine: SearchQuery.query is str not bytes
 2020-12-11 14:53:24 +01:00
Alexandre Flament 9f8ebeca44 Merge pull request #2375 from dalf/raise_for_errors 
[enh] add raise_for_httperror
 2020-12-11 14:52:18 +01:00
Alexandre Flament d703119d3a [enh] add raise_for_httperror 
check HTTP response:
* detect some comme CAPTCHA challenge (no solving). In this case the engine is suspended for long a time.
* otherwise raise HTTPError as before

the check is done in poolrequests.py (was before in search.py).

update qwant, wikipedia, wikidata to use raise_for_httperror instead of raise_for_status
 2020-12-11 14:37:08 +01:00
Alexandre Flament 033f39bff7 Merge pull request #2376 from dalf/fix-mojeek 
Fix mojeek
 2020-12-11 13:14:54 +01:00
Alexandre Flament 6bc6d5e9fd Merge pull request #2371 from dalf/mod-genius 
[mod) genious: return valid results even if contents are empty
 2020-12-11 13:14:03 +01:00
Alexandre Flament 0ba74cd812 [mod] results: don't crash when an engine don't have a category 
According to
https://github.com/searx/searx/blob/820b468bfe96f693d60ce06f1e78af51f00deefc/searx/engines/__init__.py#L87-L88

an engine can have no category at all.

Without this commit, searx raise an exception in searx/results.py

Note: in this case, the engine is not shown in the preferences.
 2020-12-10 10:57:07 +01:00
Alexandre Flament d41cafd5f3 [fix] xpath, mojeek: fix commit 58d72f2692 
before commit 58d72f2, category was not set in xpath.py,
so searx/engines/__init__py was setting the category to ['general']

the commit 58d72f2 set the category to [] which is not replaced by searx/engines/__init__.py
consequence: the mojeek engine is hidden in the preferences.

this commit revert the xpath.py change.

close #2368
 2020-12-10 10:52:06 +01:00
Alexandre Flament 1c9e7cef50 [remove] remove searchcode_doc and twitter 
* twitter: the API has changed. the engine needs to rewritten.
* searchcode_doc: the API about documentation doesn't exist anymore.
 2020-12-09 13:14:31 +01:00
Alexandre Flament fa73f10f11 [mod) genious: return valid results even if contents are empty 2020-12-09 13:01:34 +01:00
Alexandre Flament 42a194898b Merge pull request #2360 from dalf/update-libgen 
[mod] libgen: update the URL to http://libgen.rs/
 2020-12-08 20:33:53 +01:00
Alexandre Flament a77d8c8227 Merge pull request #2359 from dalf/update-duden 
[mod] duden engine
 2020-12-08 20:33:38 +01:00
Alexandre Flament bd4869ecd0 Merge pull request #2366 from dalf/remove-seedpeer 
[remove] seedpeer engine
 2020-12-08 20:33:23 +01:00
Alexandre Flament 35bf568b41 Merge pull request #2362 from return42/use_default_settings 
[doc] recommend to use 'use_default_settings=True'
 2020-12-08 20:33:06 +01:00
Alexandre Flament 56c64d6b64 [remove] seedpeer engine 
the website is offline.
 2020-12-07 21:02:29 +01:00
Alexandre Flament c1a9732268 Merge pull request #2364 from dalf/fix-youtube-noapi 
[fix] youtube_noapi engine
 2020-12-07 20:26:00 +01:00
Alexandre Flament 13d3004703 Merge pull request #2365 from dalf/fix-soundcloud 
[fix] soundclound: accept result without content
 2020-12-07 20:25:17 +01:00