offline-deals are stuck on "Waiting For DealID"

[phapawit-hir]

Checklist

• This is not a question or a support request. If you have any Curio related questions, please ask in the discussion forum.
• This is not a new feature request. If it is, please file a feature request instead.
• This is not an enhancement request. If it is, please file a improvement suggestion instead.
• I have searched on the issue tracker and the discussion forum, and there is no existing related issue or discussion.
• I am running the Latest release, or the most recent RC(release candidate) for the upcoming release or the dev branch(master), or have an issue updating to any of these.
• I did not make any code changes to curio.

Curio component

• PoRep Pipeline
• Snap Deals
• Market
• IPNI provider
• Curio UI
• Other

Curio Version

curio version 1.24.5+mainnet+git_43a3c22_2025-02-25T20:46:51+00:00

Describe the Bug

our offline-deals are stuck on "Waiting for DealID" for some reason. Curio has never found result for these messages.

query1

SELECT DISTINCT d.publish_cid
FROM curio.market_mk12_deal_pipeline mp
JOIN curio.market_mk12_deals d ON d.uuid = mp.uuid
WHERE mp.started = TRUE
AND mp.find_deal_task_id IS NULL
AND mp.after_commp = TRUE
AND mp.after_psd = TRUE
AND mp.after_find_deal = FALSE
AND NOT EXISTS (
    SELECT 1
    FROM curio.message_waits mw
    WHERE mw.signed_message_cid = d.publish_cid
    AND mw.executed_tsk_cid IS NOT NULL
);

output

publish_cid                                                   |
--------------------------------------------------------------+
bafy2bzaceb2wrpoewkx6jishqwkbauumchzasgxyxpqjkb6qsbsbaxx76evxq|
bafy2bzacecninaoaxpiqzlgm2tchuu2vgiyocxkvvqb2gyw6afl33j7kw3vzy|

query2

SELECT * 
FROM curio.message_waits
WHERE signed_message_cid IN (
    'bafy2bzaceb2wrpoewkx6jishqwkbauumchzasgxyxpqjkb6qsbsbaxx76evxq',
    'bafy2bzacecninaoaxpiqzlgm2tchuu2vgiyocxkvvqb2gyw6afl33j7kw3vzy'
);

output

signed_message_cid                                            |waiter_machine_id|executed_tsk_cid|executed_tsk_epoch|executed_msg_cid|executed_msg_data|executed_rcpt_exitcode|executed_rcpt_return|executed_rcpt_gas_used|
--------------------------------------------------------------+-----------------+----------------+------------------+----------------+-----------------+----------------------+--------------------+----------------------+
bafy2bzaceb2wrpoewkx6jishqwkbauumchzasgxyxpqjkb6qsbsbaxx76evxq|             3401|                |                  |                |                 |                      |                    |                      |
bafy2bzacecninaoaxpiqzlgm2tchuu2vgiyocxkvvqb2gyw6afl33j7kw3vzy|             3401|                |                  |                |                 |                      |                    |                      |

query3

SELECT signed_message_cid, from_key, nonce FROM curio.message_waits
                          JOIN curio.message_sends ON signed_message_cid = signed_cid
                          WHERE waiter_machine_id = 3401 LIMIT 10000;

output

signed_message_cid                                            |from_key                                                                              |nonce|
--------------------------------------------------------------+--------------------------------------------------------------------------------------+-----+
bafy2bzaceb2wrpoewkx6jishqwkbauumchzasgxyxpqjkb6qsbsbaxx76evxq|f3v7wumvh3zjsebyh7zspahxezshkywgvvgexamxz3un2jqr7omjuj3pnts4mmkkhtufgv24rjfokp62v42mna| 1797|
bafy2bzacecninaoaxpiqzlgm2tchuu2vgiyocxkvvqb2gyw6afl33j7kw3vzy|f3v7wumvh3zjsebyh7zspahxezshkywgvvgexamxz3un2jqr7omjuj3pnts4mmkkhtufgv24rjfokp62v42mna| 1798|

Logging Information

{"level":"info","ts":"2025-03-12T13:44:25.740+0700","logger":"PSD","caller":"storage-market/task_psd.go:234","msg":"published 12 deals with message CID bafy2bzaced5ahisjpat7zecibg43t4nilz77y7kr7rphf6mo4hwwpkevy4uo6"}
{"level":"info","ts":"2025-03-12T13:44:57.745+0700","logger":"PSD","caller":"storage-market/task_psd.go:234","msg":"published 12 deals with message CID bafy2bzaceb2wrpoewkx6jishqwkbauumchzasgxyxpqjkb6qsbsbaxx76evxq"}
{"level":"info","ts":"2025-03-12T13:45:25.835+0700","logger":"PSD","caller":"storage-market/task_psd.go:234","msg":"published 12 deals with message CID bafy2bzacecninaoaxpiqzlgm2tchuu2vgiyocxkvvqb2gyw6afl33j7kw3vzy"}
{"level":"info","ts":"2025-03-12T13:45:32.972+0700","logger":"storage-market","caller":"storage-market/storage_market.go:407","msg":"UUID: c52a77bd-ed34-45ce-95c9-812abfc272ca: FindDeal task created successfully"}
{"level":"info","ts":"2025-03-12T13:45:32.983+0700","logger":"storage-market","caller":"storage-market/storage_market.go:407","msg":"UUID: d2fa5d61-a988-4f84-bc4e-ea170b36d8af: FindDeal task created successfully"}
{"level":"info","ts":"2025-03-12T13:45:32.995+0700","logger":"storage-market","caller":"storage-market/storage_market.go:407","msg":"UUID: 21b7fa23-c40d-4111-87f3-96c099bf4200: FindDeal task created successfully"}
{"level":"info","ts":"2025-03-12T13:45:33.005+0700","logger":"storage-market","caller":"storage-market/storage_market.go:407","msg":"UUID: 9ae17e5b-34b0-4611-875a-419f36d0a314: FindDeal task created successfully"}
{"level":"info","ts":"2025-03-12T13:45:33.016+0700","logger":"storage-market","caller":"storage-market/storage_market.go:407","msg":"UUID: dd21872d-dcf6-4168-9c14-b66be75ae6d7: FindDeal task created successfully"}
{"level":"info","ts":"2025-03-12T13:45:33.025+0700","logger":"storage-market","caller":"storage-market/storage_market.go:407","msg":"UUID: da5a0fde-9c8e-4f38-8f85-5307de29992a: FindDeal task created successfully"}
{"level":"info","ts":"2025-03-12T13:45:33.034+0700","logger":"storage-market","caller":"storage-market/storage_market.go:407","msg":"UUID: fbbf2032-7a7d-43a0-a101-b5eb2f1410e0: FindDeal task created successfully"}
{"level":"info","ts":"2025-03-12T13:45:33.043+0700","logger":"storage-market","caller":"storage-market/storage_market.go:407","msg":"UUID: 133789eb-79f8-492f-a8a0-b2dc4464756a: FindDeal task created successfully"}
{"level":"info","ts":"2025-03-12T13:45:33.052+0700","logger":"storage-market","caller":"storage-market/storage_market.go:407","msg":"UUID: f0c33a8b-c762-46ca-b576-1d45830cfd12: FindDeal task created successfully"}
{"level":"info","ts":"2025-03-12T13:45:33.061+0700","logger":"storage-market","caller":"storage-market/storage_market.go:407","msg":"UUID: b5d6f62b-5376-4642-9534-1b5187ee9103: FindDeal task created successfully"}
{"level":"info","ts":"2025-03-12T13:45:33.070+0700","logger":"storage-market","caller":"storage-market/storage_market.go:407","msg":"UUID: 0ea389fc-e317-4a95-9f1f-a763c06d7137: FindDeal task created successfully"}
{"level":"info","ts":"2025-03-12T13:45:33.078+0700","logger":"storage-market","caller":"storage-market/storage_market.go:407","msg":"UUID: c600bba3-0144-4d56-81a2-066ce9b122ce: FindDeal task created successfully"}
{"level":"info","ts":"2025-03-12T13:45:34.495+0700","logger":"harmonytask","caller":"harmonytask/task_type_handler.go:194","msg":"Beginning work on Task","id":9010608,"from":"poller","name":"FindDeal","sector":null}
{"level":"info","ts":"2025-03-12T13:45:34.629+0700","logger":"harmonytask","caller":"harmonytask/task_type_handler.go:194","msg":"Beginning work on Task","id":9010609,"from":"poller","name":"FindDeal","sector":null}
{"level":"info","ts":"2025-03-12T13:45:34.764+0700","logger":"harmonytask","caller":"harmonytask/task_type_handler.go:194","msg":"Beginning work on Task","id":9010610,"from":"poller","name":"FindDeal","sector":null}
{"level":"info","ts":"2025-03-12T13:45:34.897+0700","logger":"harmonytask","caller":"harmonytask/task_type_handler.go:194","msg":"Beginning work on Task","id":9010611,"from":"poller","name":"FindDeal","sector":null}
{"level":"info","ts":"2025-03-12T13:45:35.031+0700","logger":"harmonytask","caller":"harmonytask/task_type_handler.go:194","msg":"Beginning work on Task","id":9010612,"from":"poller","name":"FindDeal","sector":null}
{"level":"info","ts":"2025-03-12T13:45:35.164+0700","logger":"harmonytask","caller":"harmonytask/task_type_handler.go:194","msg":"Beginning work on Task","id":9010613,"from":"poller","name":"FindDeal","sector":null}
{"level":"info","ts":"2025-03-12T13:45:35.304+0700","logger":"harmonytask","caller":"harmonytask/task_type_handler.go:194","msg":"Beginning work on Task","id":9010614,"from":"poller","name":"FindDeal","sector":null}
{"level":"info","ts":"2025-03-12T13:45:35.438+0700","logger":"harmonytask","caller":"harmonytask/task_type_handler.go:194","msg":"Beginning work on Task","id":9010615,"from":"poller","name":"FindDeal","sector":null}
{"level":"info","ts":"2025-03-12T13:45:35.661+0700","logger":"harmonytask","caller":"harmonytask/task_type_handler.go:194","msg":"Beginning work on Task","id":9010616,"from":"poller","name":"FindDeal","sector":null}
{"level":"info","ts":"2025-03-12T13:45:35.797+0700","logger":"harmonytask","caller":"harmonytask/task_type_handler.go:194","msg":"Beginning work on Task","id":9010617,"from":"poller","name":"FindDeal","sector":null}
{"level":"info","ts":"2025-03-12T13:45:35.935+0700","logger":"harmonytask","caller":"harmonytask/task_type_handler.go:194","msg":"Beginning work on Task","id":9010618,"from":"poller","name":"FindDeal","sector":null}
{"level":"info","ts":"2025-03-12T13:45:36.074+0700","logger":"harmonytask","caller":"harmonytask/task_type_handler.go:194","msg":"Beginning work on Task","id":9010619,"from":"poller","name":"FindDeal","sector":null}
{"level":"info","ts":"2025-03-12T13:46:03.019+0700","logger":"storage-market","caller":"storage-market/storage_market.go:830","msg":"Added deal c52a77bd-ed34-45ce-95c9-812abfc272ca to sector 7728"}
{"level":"info","ts":"2025-03-12T13:46:03.042+0700","logger":"storage-market","caller":"storage-market/storage_market.go:830","msg":"Added deal d2fa5d61-a988-4f84-bc4e-ea170b36d8af to sector 7729"}
{"level":"info","ts":"2025-03-12T13:46:03.064+0700","logger":"storage-market","caller":"storage-market/storage_market.go:830","msg":"Added deal 21b7fa23-c40d-4111-87f3-96c099bf4200 to sector 7730"}
{"level":"info","ts":"2025-03-12T13:46:03.083+0700","logger":"storage-market","caller":"storage-market/storage_market.go:830","msg":"Added deal 9ae17e5b-34b0-4611-875a-419f36d0a314 to sector 7731"}
{"level":"info","ts":"2025-03-12T13:46:03.103+0700","logger":"storage-market","caller":"storage-market/storage_market.go:830","msg":"Added deal dd21872d-dcf6-4168-9c14-b66be75ae6d7 to sector 7732"}
{"level":"info","ts":"2025-03-12T13:46:03.122+0700","logger":"storage-market","caller":"storage-market/storage_market.go:830","msg":"Added deal da5a0fde-9c8e-4f38-8f85-5307de29992a to sector 7733"}
{"level":"info","ts":"2025-03-12T13:46:03.140+0700","logger":"storage-market","caller":"storage-market/storage_market.go:830","msg":"Added deal fbbf2032-7a7d-43a0-a101-b5eb2f1410e0 to sector 7734"}
{"level":"info","ts":"2025-03-12T13:46:03.158+0700","logger":"storage-market","caller":"storage-market/storage_market.go:830","msg":"Added deal 133789eb-79f8-492f-a8a0-b2dc4464756a to sector 7735"}
{"level":"info","ts":"2025-03-12T13:46:03.175+0700","logger":"storage-market","caller":"storage-market/storage_market.go:830","msg":"Added deal f0c33a8b-c762-46ca-b576-1d45830cfd12 to sector 7736"}
{"level":"info","ts":"2025-03-12T13:46:03.193+0700","logger":"storage-market","caller":"storage-market/storage_market.go:830","msg":"Added deal b5d6f62b-5376-4642-9534-1b5187ee9103 to sector 7737"}
{"level":"info","ts":"2025-03-12T13:46:03.212+0700","logger":"storage-market","caller":"storage-market/storage_market.go:830","msg":"Added deal 0ea389fc-e317-4a95-9f1f-a763c06d7137 to sector 7738"}
{"level":"info","ts":"2025-03-12T13:46:03.229+0700","logger":"storage-market","caller":"storage-market/storage_market.go:830","msg":"Added deal c600bba3-0144-4d56-81a2-066ce9b122ce to sector 7739"}

Repo Steps

1. Get offline-deals from client
2. Curio-Market proceed the task
3. almost deals get stuck on "Waiting For DealID"