Skip to content
GitLab
Projects
Groups
Snippets
Help
Loading...
Help
What's new
10
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Open sidebar
memoriav
M
Memobase 2020
services
URL Checker
Commits
dc2eab67
Commit
dc2eab67
authored
Nov 24, 2020
by
Juergen Enge
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
crawlerror including lastcheck<lastchange
parent
8c9afab8
Pipeline
#17742
passed with stages
in 1 minute and 59 seconds
Changes
1
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
7 additions
and
2 deletions
+7
-2
pkg/memocrawler/crawler.go
pkg/memocrawler/crawler.go
+7
-2
No files found.
pkg/memocrawler/crawler.go
View file @
dc2eab67
...
...
@@ -156,8 +156,13 @@ func (cr *Crawler) CrawlError() error {
sqlstr
:=
fmt
.
Sprintf
(
"SELECT sig AS signature, uri, access, proto AS protocol, `status` "
+
" FROM %s.entities"
+
" WHERE status='error'"
+
" AND lastcheck > TIMESTAMPADD(SECOND, ?, NOW())"
+
" AND lastcheck < TIMESTAMPADD(SECOND, ?, NOW())"
+
" AND ("
+
" lastcheck < lastchange"
+
" OR ("
+
" lastcheck > TIMESTAMPADD(SECOND, ?, NOW())"
+
" AND lastcheck < TIMESTAMPADD(SECOND, ?, NOW())"
+
" )"
+
")"
+
" ORDER BY lastchange ASC"
,
cr
.
schema
)
for
{
entries
,
err
:=
cr
.
getEntries
(
sqlstr
,
int64
(
cr
.
crawlErrorNew
/
time
.
Second
),
int64
(
cr
.
crawlError
/
time
.
Second
))
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment