임베디드 리눅스 멈춤 증상 관련 질문
안녕하세요 현재 리눅스 개발을 진행하고 있는 초보 개발자입니다.
현재 i.mx6 quad CPU에 Kernel, APP이랑 구축해서 운영중인데
운영 중에 불특정한 주기로 아래 메시지가 발생하면서 APP이 멈추고 터미널 입력(putty)도 안먹는 상황이 발생하게 됩니다.
[347274.686948] INFO: rcu_preempt detected stalls on CPUs/tasks:
[347274.692715] 0-...: (1 ticks this GP) idle=943/140000000000001/0 softirq=34286512/34286512 fqs=1
[347274.701674] (detected by 3, t=151567997 jiffies, g=12979956, c=12979955, q=4470230)
[347274.709521] Task dump for CPU 0:
[347274.712837] Test_C_APP R running task 0 363 362 0x00000002
[347274.720008] rcu_preempt kthread starved for 151567995 jiffies! g12979956 c12979955 f0x2 RCU_GP_WAIT_FQS(3) ->state=0x100
[347274.730963] rcu_preempt W 0 7 2 0x00000000
[347274.736560] [<80980f54>] (__schedule) from [<80981450>] (schedule+0x58/0xb8)
[347274.743703] [<80981450>] (schedule) from [<809846a8>] (schedule_timeout+0x1d4/0x480)
[347274.751540] [<809846a8>] (schedule_timeout) from [<80187950>] (rcu_gp_kthread+0x454/0x9b4)
[347274.759898] [<80187950>] (rcu_gp_kthread) from [<8014a900>] (kthread+0x118/0x120)
[347274.767474] [<8014a900>] (kthread) from [<80108338>] (ret_from_fork+0x14/0x3c)
[347337.736947] INFO: rcu_preempt detected stalls on CPUs/tasks:
[347337.742715] 0-...: (1 ticks this GP) idle=943/140000000000001/0 softirq=34286512/34286512 fqs=1
[347337.751674] (detected by 3, t=151574302 jiffies, g=12979956, c=12979955, q=4470230)
[347337.759521] Task dump for CPU 0:
[347337.762836] Test_C_APP R running task 0 363 362 0x00000002
[347337.770007] rcu_preempt kthread starved for 151574300 jiffies! g12979956 c12979955 f0x2 RCU_GP_WAIT_FQS(3) ->state=0x100
[347337.780962] rcu_preempt W 0 7 2 0x00000000
[347337.786558] [<80980f54>] (__schedule) from [<80981450>] (schedule+0x58/0xb8)
[347337.793701] [<80981450>] (schedule) from [<809846a8>] (schedule_timeout+0x1d4/0x480)
[347337.801537] [<809846a8>] (schedule_timeout) from [<80187950>] (rcu_gp_kthread+0x454/0x9b4)
[347337.809895] [<80187950>] (rcu_gp_kthread) from [<8014a900>] (kthread+0x118/0x120)
[347337.817472] [<8014a900>] (kthread) from [<80108338>] (ret_from_fork+0x14/0x3c)
[347400.786948] INFO: rcu_preempt detected stalls on CPUs/tasks:
[347400.792715] 0-...: (1 ticks this GP) idle=943/140000000000001/0 softirq=34286512/34286512 fqs=1
[347400.801674] (detected by 3, t=151580607 jiffies, g=12979956, c=12979955, q=4470230)
[347400.809521] Task dump for CPU 0:
[347400.812837] Test_C_APP R running task 0 363 362 0x00000002
[347400.820007] rcu_preempt kthread starved for 151580605 jiffies! g12979956 c12979955 f0x2 RCU_GP_WAIT_FQS(3) ->state=0x100
[347400.830963] rcu_preempt W 0 7 2 0x00000000
[347400.836560] [<80980f54>] (__schedule) from [<80981450>] (schedule+0x58/0xb8)
[347400.843703] [<80981450>] (schedule) from [<809846a8>] (schedule_timeout+0x1d4/0x480)
[347400.851540] [<809846a8>] (schedule_timeout) from [<80187950>] (rcu_gp_kthread+0x454/0x9b4)
[347400.859898] [<80187950>] (rcu_gp_kthread) from [<8014a900>] (kthread+0x118/0x120)
[347400.867475] [<8014a900>] (kthread) from [<80108338>] (ret_from_fork+0x14/0x3c)
증상 자체도 너무 불특정주기로 발생을해서 디버깅을 하기가 쉽지 않네요.. 혹시 유사 증상이나 로그 관련해서 내용 아시는분 있을까요? 커널 버전은 4.9.67-fslc+g953c6e30c970 사용중입니다.
혹시 해결법을 아시면 도움을 주시면 감사하겠습니다.
댓글 달기