cybrneko/searxng-nekosearch
1
0
Fork 0
Code Issues Pull Requests Actions 1 Activity
4,176 Commits 6 Branches 0 Tags
9a05ad4c73a6da1ae1cbdc2cc890a52acf25440a
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Alexandre Flament f251a9718e Merge pull request #9 from return42/drop-https-rewrite 
[drop] plugin HTTPS rewrite - rule base is to old (update is to big)
 2021-04-22 11:55:58 +02:00
Alexandre Flament c6d5605d27 Merge pull request #7 from searxng/metrics 
Metrics
 2021-04-22 08:34:17 +02:00
Alexandre Flament baff1cbbab fix issues from review 2021-04-21 18:49:13 +02:00
Alexandre Flament b7848e3422 [fix] searxng fix: sjp engine 2021-04-21 16:31:29 +02:00
Alexandre Flament 7cfd8d900a [mod] oscar: /preferences , engines tab: report engine times 
* display the median time instead of the average.
* add a "Reliability" column (sum up the metrics and the checker results).
* the "selected language", "SafeSearch", "Time range" values are displayed as "broken" when the checker tests fail.
 2021-04-21 16:24:46 +02:00
Alexandre Flament c27fef1cde [mod] metrics: add secondary parameter 
Some error won't stop the engine:
* additional HTTP redirects for example
* some invalid results

secondary=True allows to flag these errors as not important.
 2021-04-21 16:24:46 +02:00
Alexandre Flament 7acd7ffc02 [enh] rewrite and enhance metrics 2021-04-21 16:24:46 +02:00
Alexandre Flament aae7830d14 [mod] refactoring: processors 
Report to the user suspended engines.

searx.search.processor.abstract:
* manages suspend time (per network).
* reports suspended time to the ResultContainer (method extend_container_if_suspended)
* adds the results to the ResultContainer (method extend_container)
* handles exceptions (method handle_exception)
 2021-04-21 16:24:46 +02:00
Alexandre Flament ae5954f2da Merge remote-tracking branch 'return42/fix-preference-save' 2021-04-21 16:24:22 +02:00
Alexandre Flament 624d3ec6db Merge remote-tracking branch 'return42/fix-url-bar-suggestion' 2021-04-21 16:23:52 +02:00
Alexandre Flament 92db0227b1 Merge remote-tracking branch 'dalf/oscar-images' 2021-04-19 09:36:54 +02:00
Alexandre Flament 48720e20a8 Merge remote-tracking branch 'searx/master' 2021-04-19 09:35:12 +02:00
Alexandre Flament 01cefffbf6 Merge pull request #1 from metasearch-lab/httpx_networks 
Httpx networks
 2021-04-12 17:34:21 +02:00
Alexandre Flament d14994dc73 [httpx] replace searx.poolrequests by searx.network 
settings.yml:

* outgoing.networks:
   * can contains network definition
   * propertiers: enable_http, verify, http2, max_connections, max_keepalive_connections,
     keepalive_expiry, local_addresses, support_ipv4, support_ipv6, proxies, max_redirects, retries
   * retries: 0 by default, number of times searx retries to send the HTTP request (using different IP & proxy each time)
   * local_addresses can be "192.168.0.1/24" (it supports IPv6)
   * support_ipv4 & support_ipv6: both True by default
     see https://github.com/searx/searx/pull/1034
* each engine can define a "network" section:
   * either a full network description
   * either reference an existing network

* all HTTP requests of engine use the same HTTP configuration (it was not the case before, see proxy configuration in master)
 2021-04-12 17:25:56 +02:00
Alexandre Flament eaa694fb7d [enh] replace requests by httpx 2021-04-10 15:38:33 +02:00
Alexandre Flament 111180705b [fix] test: avoid HTTP requests 
patch engine initialization to skip HTTP request
(engine_init function in searx.engines.initialize_engines)
 2021-04-10 15:38:27 +02:00
Alexandre Flament c09ff4faf2 [fix] fix PR 2656 
SCRIPT_NAME remove trailing slash to avoid infinite redirect
 2021-04-07 13:05:55 +02:00
Alexandre Flament 7089526723 Merge pull request #2656 from return42/fix-url_for 
[fix] url_for(..., _external=True) in templates
 2021-04-05 14:50:39 +02:00
Alexandre Flament 7a0fbdecc4 [enh] oscar: image thumbnail layout 
Adjust thumbnail sizes to fill the container width
 2021-04-05 11:29:17 +02:00
Alexandre Flament ac0fdc3b96 Merge pull request #2702 from MarcAbonce/fix-dark-infobox 
Fix dark "expand" button from infobox
 2021-04-02 10:38:11 +02:00
Alexandre Flament bb316d2698 Merge pull request #2682 from dalf/fix-checker 
[fix] checker: various bug fixes
 2021-03-27 17:44:29 +01:00
Alexandre Flament 725a69616b Merge pull request #2681 from dalf/fix-wikipedia-title 
[fix] wikipedia: remove HTML from the title
 2021-03-27 17:43:36 +01:00
Alexandre Flament 672ac91f3e Merge pull request #2684 from searx/dependabot/pip/master/linuxdoc-20210324 
Bump linuxdoc from 20210110 to 20210324
 2021-03-26 13:21:05 +01:00
Alexandre Flament e27e0c4843 Merge pull request #2683 from searx/dependabot/pip/master/lxml-4.6.3 
Bump lxml from 4.6.2 to 4.6.3
 2021-03-26 08:11:53 +01:00
Alexandre Flament ae0b621ec8 [mod] Dockerfile: remove protobuff dependency 
See https://github.com/searx/searx/pull/2481
 2021-03-25 17:09:28 +01:00
Alexandre Flament 0b45afd4d7 [fix] checker: various bug fixes 
* initialize engine_data (youtube engine)
* don't crash if an engine don't set result['url']
 2021-03-25 09:37:37 +01:00
Alexandre Flament fcfcf662ff [fix] wikipedia: remove HTML from the title 
fr.wikipedia.org (and it seems not other wikipedia websites),
adds HTML to api_result['displayTitle'].
(Search for '!wp :fr Braid' for example)

The commit uses api_result['title']
 2021-03-25 08:31:39 +01:00
Alexandre Flament 5f7056cf37 Merge pull request #2661 from dalf/pref-engine-tooltip 
[mod] preferences: a tooltip is shown when the mouse is over the engine names
 2021-03-22 13:36:52 +01:00
Alexandre Flament d648001688 [mod] preferences: a tooltip is shown when the mouse is over the engine names 2021-03-22 08:22:59 +01:00
Alexandre Flament bfd4e1b342 Merge pull request #2673 from dalf/fix-oscar-sourcemaps 
[mod] oscar: fix the sourcemap URL in *.min.css
 2021-03-22 08:16:46 +01:00
Alexandre Flament 6bd01bf81f [mod] oscar: fix the sourcemap URL in *.min.css 
Close https://github.com/searx/searx/issues/2670

Note: clean-css contains a bug:
* a multiline comment or URL adds "$stdin" to the sourcemap (see src/less/logicodev/search.less)
* in this case when the user opens the devtools, the browser fails to load this "https://.../$stdin" URL
* it is not a problem and the error appears only when the user actively tries to debug the CSS.
* seems related to https://github.com/jakubpawlowicz/clean-css/issues/593
 2021-03-21 18:03:40 +01:00
Alexandre Flament a48ec0b4bd Merge pull request #2671 from searx/update-soundcloud 
[mod] soundcloud: faster initialization
 2021-03-21 15:10:39 +01:00
Alexandre Flament 30c950a2c7 Merge pull request #2660 from dalf/upd-translations 
[mod] replace /translations.js with an embedded JSON
 2021-03-21 12:39:26 +01:00
Alexandre Flament 38c210d746 [mod] soundcloud: faster initialization 
The get_cliend_id() function:
* fetches https://soundcloud.com
* then fetches each referenced javascript URL to get the client id.

This commit fetches the javascript URLs in the reverse order: the client id is in the last javascript URL.
 2021-03-21 09:29:53 +01:00
Alexandre Flament 12fa524cf7 Merge pull request #2667 from searx/dependabot/pip/master/twine-3.4.1 
Bump twine from 3.3.0 to 3.4.1
 2021-03-20 19:50:27 +01:00
Alexandre Flament 7a05d5c9cd Merge pull request #2669 from jhigginbotham/master 
Update settings.yml to enable HTTP for yacy engine
 2021-03-20 18:37:24 +01:00
Alexandre Flament 7e5553ddb6 Merge pull request #2662 from dalf/oscar-trim-space 
[mod] oscar: remove space
 2021-03-18 09:50:52 +01:00
Alexandre Flament 2b0dd96bd3 [mod] oscar: remove space 
* reduce by 15% the uncompressed output (on average)
* dos2unix searx/templates/oscar/result_templates/files.html
 2021-03-17 09:22:05 +01:00
Alexandre Flament 6553c79029 [mod] replace /translations.js by embedded JSON 
In webapp.py, there is a new function "get_translations" lists available translations

Close #2064
 2021-03-16 11:22:21 +01:00
Alexandre Flament cb3b379161 Merge pull request #2206 from dalf/upgrade-pygments 
[mod] upgrade pygments
 2021-03-16 11:06:25 +01:00
Alexandre Flament 32cd0d31b3 [mod] upgrade pygments 
add searx_extra/update/update_pygments.py to update the css style of the oscar and simple themes.
 2021-03-16 09:07:08 +01:00
Alexandre Flament 1664258061 Merge pull request #2655 from return42/fix-imports 
[fix] remove unused import from yahoo-news engine
 2021-03-15 08:38:34 +01:00
Alexandre Flament 5b176b3496 Merge pull request #2659 from MarcAbonce/onions-http-fix 
Fix HTTP error in onion engines
 2021-03-15 08:33:38 +01:00
Alexandre Flament 0b71d61dfc Merge pull request #2654 from return42/acgsou 
[drop] Acgsou engine - www.acgsou.com no longer exists
 2021-03-15 08:27:15 +01:00
Alexandre Flament 9292571304 Merge pull request #2346 from dalf/upgrade-oscar 
[mod] oscar: upgrade dependencies
 2021-03-13 09:29:13 +01:00
Alexandre Flament 92dd5e245e Merge pull request #2626 from mikeri/solidtorrents 
Add Solid Torrents engine
 2021-03-12 19:45:22 +01:00
Alexandre Flament a1a492baed Merge pull request #2641 from dalf/disable_http_by_default 
[mod] by default allow only HTTPS, not HTTP
 2021-03-12 19:21:46 +01:00
Alexandre Flament af3e969c5a Merge pull request #2642 from return42/fix-apkmirror 
[fix] APKMirror engine - update xpath selectors and fix img_src
 2021-03-11 09:48:31 +01:00
Alexandre Flament 8b650e6a2d Merge pull request #2643 from return42/fix-makefile 
[fix] make targets engines.languages and useragents.update
 2021-03-11 09:44:30 +01:00
Alexandre Flament cb04d42806 [mod] oscar: update README.rst 2021-03-11 09:33:04 +01:00
Alexandre Flament 86912e2272 [mod] oscar: get bootstrap and typeahead from NPM 2021-03-11 09:33:01 +01:00
Alexandre Flament 44407353ef [mod] oscar: get leaflet and jquery from NPM 
easy to upgrade (package.json)
 2021-03-11 09:32:22 +01:00
Alexandre Flament c7133efb12 [mod] oscar: move compiled files to the src directory 2021-03-10 19:28:51 +01:00
Alexandre Flament eda3b513ac [mod] oscar: remove polyfills for Internet Explorer 2021-03-10 19:01:16 +01:00
Alexandre Flament 1268910274 [mod] oscar: remove unused images 2021-03-10 19:01:16 +01:00
Alexandre Flament bdb41bea7b [mod] theme: remove require-2.1.15.min.js 
See https://github.com/requirejs/requirejs/issues/1816

requirejs loads one file: leaflet.

This commit:
* removes requirejs
* load leaflet using <script src...> HTML tag in searx/templates/oscar/base.html
 2021-03-10 19:01:15 +01:00
Alexandre Flament 2f3d5ec2af [mod] oscar: upgrade npm dependencies 2021-03-10 19:01:14 +01:00
Alexandre Flament ccf5ac9801 Merge pull request #2640 from return42/fix-yahoo-news 
[fix] rewrite Yahoo-News engine
 2021-03-08 19:03:41 +01:00
Alexandre Flament 99e0651cea [mod] by default allow only HTTPS, not HTTP 
Related to https://github.com/searx/searx/pull/2373
 2021-03-08 11:35:08 +01:00
Alexandre Flament 87f4cc4a9e Merge pull request #2631 from searx/update_data_update_languages.py 
Update searx.data - update_languages.py
 2021-03-06 10:03:00 +01:00
Alexandre Flament 63e696372b Merge pull request #2634 from return42/fedora 
[mod] LXC switch to Fedora 33 / Fedora 31 reached its EOL
 2021-03-05 21:56:18 +01:00
Alexandre Flament 70c38a93d0 Merge pull request #2635 from return42/einit 
[mod] don't dump traceback of SearxEngineResponseException on init
 2021-03-05 21:55:00 +01:00
Alexandre Flament 0165e14a7f Merge pull request #2632 from searx/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2021-03-05 11:59:44 +01:00
Alexandre Flament 152f6fc1da Merge pull request #2630 from searx/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2021-03-05 11:59:20 +01:00
Alexandre Flament d7fb55a774 Merge pull request #2633 from searx/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2021-03-05 11:59:05 +01:00
Alexandre Flament 10ecc303c9 Fix integration.yml 
Don't run twice the workflow on PR opened from the same repository.
 2021-03-05 11:54:45 +01:00
Alexandre Flament 245f8626dd Fix data-update.yml, run once a month 2021-03-05 11:12:31 +01:00
Alexandre Flament d9a35fc28e Fix data-update.yml 2021-03-05 10:24:54 +01:00
Alexandre Flament 917dff3aab Update data-update.yml 
Allow to manually running the workflow

See:
* https://docs.github.com/en/actions/managing-workflow-runs/manually-running-a-workflow
* https://docs.github.com/en/actions/reference/events-that-trigger-workflows#workflow_dispatch
 2021-03-05 10:16:59 +01:00
Alexandre Flament b97273df6b Update data-update.yml 
Remove cache
 2021-03-05 09:49:39 +01:00
Alexandre Flament aaae9a209e Merge pull request #2600 from dalf/searx-extra 
Add searx_extra package
 2021-03-05 09:43:39 +01:00
Alexandre Flament b8cd326464 Add searx_extra package 
Split the utils directory into:
* searx_extra contains update scripts, standalone_searx.py
* utils contains the files to build and setup searx.
 2021-03-04 11:59:14 +01:00
Alexandre Flament 1d10ae175c Merge pull request #2618 from thezeroalpha/master 
Fix security vulnerabilities in provided nginx configuration
 2021-03-04 11:27:03 +01:00
Alexandre Flament 6ba37777f7 Merge pull request #2623 from return42/fix-centos7 
[fix] add package `which` to CentOS-7 boilerplate
 2021-03-04 11:19:05 +01:00
Alexandre Flament d26261c5ab Merge pull request #2619 from return42/drop-ubu1604 
[mod] Drop Ubuntu 16.04 (Xenial Xerus) support
 2021-03-04 11:18:21 +01:00
Alexandre Flament 4c2a8aea39 Merge pull request #2620 from return42/fix-git 
[fix] support git versions <v2.22
 2021-03-04 11:17:24 +01:00
Alexandre Flament aac37f288f Merge pull request #2593 from dalf/update-autocomplete 
Update autocomplete
 2021-03-04 10:51:09 +01:00
Alexandre Flament c748fc66cf Merge pull request #2610 from searx/dependabot/pip/master/pylint-2.7.2 
Bump pylint from 2.6.2 to 2.7.2
 2021-03-02 10:12:32 +01:00
Alexandre Flament 87ac6df9fc Merge pull request #2611 from return42/google-scolar 
[enh] google scholar - python implementation of the engine
 2021-03-02 10:05:49 +01:00
Alexandre Flament 63f17d2e4c [enh] autocomplete refactoring, autocomplete on external bangs 2021-03-01 19:12:32 +01:00
Alexandre Flament 4fa1290c11 [fix] answers: don't crash when the query is an empty string 2021-03-01 10:52:39 +01:00
Alexandre Flament e2fb500892 Merge pull request #2608 from return42/unittest2 
[py2to3] use unittest from py3, remove unittest2 from py2
 2021-03-01 10:05:38 +01:00
Alexandre Flament 0c663e25fc Merge pull request #2604 from searx/update_data_firefox_version 
Update searx.data - firefox_version
 2021-03-01 10:03:39 +01:00
Alexandre Flament f77983e174 Merge pull request #2602 from MarcAbonce/fix-bing-fetch-languages 
Fix fetch_languages for Bing
 2021-03-01 09:06:37 +01:00
Alexandre Flament b05f4d0664 Merge pull request #2605 from searx/update_data_currencies 
Update searx.data - currencies
 2021-02-26 12:56:32 +01:00
Alexandre Flament aec5188b51 Merge pull request #2606 from searx/update_data_wikidata_units 
Update searx.data - wikidata_units
 2021-02-26 12:55:51 +01:00
Alexandre Flament 28ed5acde5 Merge pull request #2607 from searx/update_data_ahmia_blacklist 
Update searx.data - ahmia_blacklist
 2021-02-26 12:55:26 +01:00
Alexandre Flament 728e096764 data-update.yml: on PR per file 2021-02-25 08:41:17 +01:00
Alexandre Flament 7c1847d5f2 [mod] add utils/fetch_external_bangs.py 
Based on duckduckgo bangs
Store bangs on a trie to allow autocomplete (not in this commit)
 2021-02-24 18:48:36 +01:00
Alexandre Flament 606aa79e49 Merge pull request #2584 from searx/dependabot/pip/master/sphinx-3.5.1 
Bump sphinx from 3.4.1 to 3.5.1
 2021-02-24 13:52:15 +01:00
Alexandre Flament 5f4a085fc4 Merge pull request #2595 from dalf/update-wikidata-units 
[mod] update wikidata_units.json and fetch_wikidata_units.py
 2021-02-23 17:22:37 +01:00
Alexandre Flament 94c9320c6f Merge pull request #2585 from dalf/update-currencies 
[mod] update currencies.json and fetch_currencies.py
 2021-02-23 17:22:05 +01:00
Alexandre Flament 46ca32c3cc [mod] update currencies.json and fetch_currencies.py 
use a sparql request on wikidata to get the list of currencies.

currencies.json contains the translation for all supported searx languages.

Supersede #993
 2021-02-23 16:42:28 +01:00
Alexandre Flament 93d1da4906 [mod] update wikidata_units.json and fetch_wikidata_units.py 
The fetch_wikidata_units.py result won't change randomly.
See comments in the script.
 2021-02-23 13:10:38 +01:00
Alexandre Flament 9ace31c829 Merge pull request #2588 from datagram1/master 
Added rumble.com video search engine.
 2021-02-21 14:08:02 +01:00
Alexandre Flament 640d6ce778 Update dependabot.yml 2021-02-19 13:08:57 +01:00
Alexandre Flament fd1b8f661b Update dependabot.yml 2021-02-16 18:42:44 +01:00
Alexandre Flament 3ee24b685a Create dependabot.yml 
Only pip packages and ignore pygments, related to https://github.com/searx/searx/pull/2206
 2021-02-16 18:41:34 +01:00
Alexandre Flament 44a6593c13 Merge pull request #2573 from unixfox/yggtorrent 
update yggtorrent url + add it back
 2021-02-16 08:22:07 +01:00
Alexandre Flament 09e28ae779 Merge pull request #2570 from xenrox/improve-peertube 
Improve peertube searching
 2021-02-16 08:17:42 +01:00