Skip to content
GitLab
Menu
Projects
Groups
Snippets
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
memoriav
Memobase 2020
services
postprocessing
Media Metadata Indexer
Commits
4eee20d4
Unverified
Commit
4eee20d4
authored
Nov 27, 2020
by
Sebastian Schüpbach
Browse files
log mariadb commit errors explicitly
parent
8cbc9c67
Changes
1
Hide whitespace changes
Inline
Side-by-side
mediametadatatodb_app/resources/MediametadataToDB.py
View file @
4eee20d4
...
...
@@ -318,18 +318,36 @@ class MediametadataToDB:
"digitalObject is unavailable"
)
if
record_number
%
100
==
0
:
_write_values_in_db
(
mariadb_cursor
,
record_values_for_db
)
mariadb_connection
.
commit
()
for
record_value
in
record_values_for_db
:
logging
.
info
(
f
'Record
{
record_value
[
"sig"
]
}
successfully indexed'
)
reporter
.
send_message
(
record_value
[
'sig'
],
"SUCCESS"
,
"Indexing successful"
)
try
:
mariadb_connection
.
commit
()
for
record_value
in
record_values_for_db
:
logging
.
info
(
f
'Record
{
record_value
[
"sig"
]
}
successfully indexed'
)
reporter
.
send_message
(
record_value
[
'sig'
],
"SUCCESS"
,
"Indexing successful"
)
except
mariadb
.
Error
as
error
:
logging
.
error
(
error
)
for
record_value
in
record_values_for_db
:
logging
.
info
(
f
'Indexing of record
{
record_value
[
"sig"
]
}
failed'
)
reporter
.
send_message
(
record_value
[
'sig'
],
"FATAL"
,
"Indexing failed"
)
record_values_for_db
=
[]
consumer
.
commit
()
if
counter
%
1000
==
0
:
logging
.
info
(
'{} messages read till now'
.
format
(
counter
))
# arriving here means there are no new messages to poll from
_write_values_in_db
(
mariadb_cursor
,
record_values_for_db
)
mariadb_connection
.
commit
()
try
:
mariadb_connection
.
commit
()
for
record_value
in
record_values_for_db
:
logging
.
info
(
f
'Record
{
record_value
[
"sig"
]
}
successfully indexed'
)
reporter
.
send_message
(
record_value
[
'sig'
],
"SUCCESS"
,
"Indexing successful"
)
except
mariadb
.
Error
as
error
:
logging
.
error
(
error
)
for
record_value
in
record_values_for_db
:
logging
.
info
(
f
'Indexing of record
{
record_value
[
"sig"
]
}
failed'
)
reporter
.
send_message
(
record_value
[
'sig'
],
"FATAL"
,
"Indexing failed"
)
for
record_value
in
record_values_for_db
:
reporter
.
send_message
(
record_value
[
'sig'
],
"SUCCESS"
,
"Indexing successful"
)
record_values_for_db
=
[]
...
...
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment