Android NDK项目崩溃信息抓取

破晓 · 发表于 2015-1-16 14:10:24

本帖最后由破晓于 2015-1-16 14:12 编辑

<span style="background-color: white;">cocos2d-x lua binding,android-ndk-r9c,eclipse,cygwin,window7 64bit,red mi,Thl9,htc one</span>

复制代码

项目最近进入高速迭代阶段,版本更新速度比平时加快了几倍,这几天出的版本莫名的出现频繁崩溃闪退的问题(仅仅Android上),不得已停下逻辑开发工作去fix 这个问题.

问题重现

打开游戏进入场景频繁切换模块界面的时候有一定几率崩溃

初步猜测

很大可能是加载销毁UI资源的时候导致C++代码出错.而仅仅在Android上出问题就有可能是挂在异步加载的线程上.由于最近两周才做的UI资源分模块管理和异步加载.所以异步子线程出的问题非常大.

这个问题的难点在于,C++代码在android上调试比较困难,由于我们的项目(cocos2d-x lua)并非单纯的NDK项目所以并不能完全用单步调试JNI的方式解决.需要知道问题的根源还是必须从想办法抓取崩溃最后的打印信息开始.

LogCat打印内容

在游戏崩溃的时候可以轻易跟踪到打印出最后两句内容:

mtk_dlmalloc_debug DEBUG_INFO]FUNCTION internal_inspect_all Line ....略
libc - Fatal signal 11 (SIGSEGV) at 0xdeadbaad (code=1), thread 6034 (Thread-531)

复制代码

这种mtk_dlmalloc_debug信息从libc库中引发,初步猜想是从用户层的原生库ibc.so引发.但是仅仅从这两句log来看并不能十分确认问题的所在. 下面我们换一种方式抓取.

ndk-stack工具抓取

ndk-stack工具的使用对于源码调试非常有用,如果是项目本身的代码(非底层原生库)出BUG的话,崩溃的时候甚至能打印出代码的行数.抓取命令:

adb logcat | ndk-stack -sym "E:\rect\SrcClient\Game\proj.android\obj\local\armeabi-v7a"

复制代码

要点在于编译C++代码的时候打开所有DEBUG选项,包括NDK的 NDK_DEBUG = 1 个人建议把V=1也加上,这样在eclipse编译C++代码的时候能把所有NDK命令都打印出来.对于我这种命令行控来说再好不过.通过ndk-stack 在游戏崩溃的时候抓到如下内容

********** Crash dump: **********
Build fingerprint: 'Xiaomi/2013022/HM2013022:4.2.1/HM2013022/JHACNBF17.0:user/release-keys'
pid: 5555, tid: 5578, name: Thread-486 >>> com.cmge.onepiece < <<
signal 11 (SIGSEGV), code 1 (SEGV_MAPERR), fault addr deadbaad
Stack frame I/DEBUG ( 5612): #00 pc 000246a8 /system/lib/libc.so: Routine ??
??:0
Stack frame I/DEBUG ( 5612): #01 pc 00016cac /system/lib/libc.so (dlmalloc+4908): Routine ??
??:0
Stack frame I/DEBUG ( 5612): #02 pc 0000cb6c /system/lib/libc.so (malloc+16): Routine ??
??:0
Stack frame I/DEBUG ( 5612): #03 pc 00dc6a88 /data/app-lib/com.aaa.bbb-1/libogame.so (operator new(unsigned int)+24): Routi
ne operator new(unsigned int) at ??:?
Stack frame I/AEE/AED ( 5612): #00 pc 000246a8 /system/lib/libc.so: Routine ??
??:0
Stack frame I/AEE/AED ( 5612): #01 pc 00016cac /system/lib/libc.so (dlmalloc+4908): Routine ??
??:0
Stack frame I/AEE/AED ( 5612): #02 pc 0000cb6c /system/lib/libc.so (malloc+16): Routine ??
??:0
Stack frame I/AEE/AED ( 5612): #03 pc 00dc6a88 /data/app-lib/com.aaa.bbb-1/libgame.so (operator new(unsigned int)+24): Routi
ne operator new(unsigned int) at ??:?

复制代码

这个log传递给我们的信息比之前的丰富多了.我们几乎可以确认这个崩溃和内存的申请释放有关,从

operator new(unsigned int)+24

复制代码

来看有可能是在new某块内存的时候引发的崩溃, 不一定是 unsigned int,因为我猜测很多时候翻译为int是不准确的.可能是玩的反编译多了我很不信任翻译为int的内容. 目前为止我们能确认和内存有关,但是并没有证据证明和线程有关系,所以必须有最后一步:NDK-GDB尝试调试.

ndk-gdb调试

ndk-gdb是NDK提供的一个调试工具,我之前并没有用过它.所以在正确使用这个工具之前遇到了几个问题,在这里记录一下,由于工具在win平台上需要使用到cygwin,所以第一步是配置cygwin.第二步是使用ndk-build生成可供ndk-gdb调试的文件,第三步才是进行调试
配置Cygwin

cygwin下载默认安装
配置环境变量

例如我的加入环境变量

NDK_MODULE_PATH =
/cygdrive/e/rect/SrcClient:/cygdrive/e/rect/SrcClient/cocos2dx/platform/third_party/android/prebuilt

复制代码

修改.bash_profile,例如我本地的:

ANDROID_NDK_ROOT=/cygdrive/e/rect/android-ndk-r9c
export ANDROID_NDK_ROOT
NDK_MODULE_PATH = /cygdrive/e/rect/SrcClient:/cygdrive/e/rect/SrcClient/cocos2dx/platform/third_party/android/prebuilt
export NDK_MODULE_PATH

复制代码

此全部配置完毕.
NDK-BUILD命令行编译C++
命令如下

ndk-build clean all NDK_DEBUG=1

复制代码

lean all 的意思是编译之前先清理全部上次生成的内容,如果不加这个参数则会报 patten %之类的错误.NDK_DEBUG=1 意思是生成调试版本的文件.加了这个参数后调试的时候能定位到源码行数.整个编译过程大约持续30分钟.
NDK-GDB 调试
调试命令为(需手机连接电脑,并且在手机上运行游戏)

ndk-gdb --verbose

复制代码

NDK-GDB这个工具略坑,在正常工作之前抽了几次风.

抽风之一

ndk-gdb Could not extract package’s data directory. Are you sure that your installed application is debuggable?

解决:修改ndk根目录下的ndk-gdb文件

old:adb_var_shell2 DATA_DIR run-as $PACKAGE_NAME /system/bin/sh -c pwd
new

ATA_DIR=”/data/data/$PACKAGE_NAME”

抽风之二

gdb.setp 生成的源码路径错乱,就像下面这样

$ ndk-gdb --verbose
Android NDK installation path: /cygdrive/e/rect/android-ndk-r9c
Using default adb command: /cygdrive/e/rect/adt-bundle-windows/sdk/platform-tools/adb
ADB version found: Android Debug Bridge version 1.0.31
Using ADB flags:
Using JDB command: /cygdrive/c/Program Files/Java/jdk1.7.0_51/bin/jdb
Using auto-detected project path: .
Found package name: com..aaa.bbb
ABIs targetted by application: armeabi-v7a armeabi
Device API Level: 10
Device CPU ABIs: armeabi-v7a armeabi
Compatible device ABI: armeabi-v7a
Using gdb setup init: ./libs/armeabi-v7a/gdb.setup
Using toolchain prefix: /cygdrive/e/rect/android-ndk-r9c/toolchains/arm-linux-androideabi-4.6/prebuilt/windows-x86_64/bin/arm-linux-androideabi-
Using app out directory: ./obj/local/armeabi-v7a
Found debuggable flag: true
Found data directory: '/data/data/com..aaa.bbb'
Found device gdbserver: /data/data/com..aaa.bbb/lib/gdbserver
Found running PID: 8351
Launched gdbserver succesfully.
Setup network redirection
## COMMAND: adb_cmd shell run-as com.cmge.onepiece /data/data/com.aaa.bbb/lib/gdbserver +debug-socket --attach 8351
## COMMAND: adb_cmd forward tcp:5039 localfilesystem:/data/data/com.aaa.bbb/debug-socket
run-as: Package 'com.cmge.onepiece' has corrupt installation
## COMMAND: adb_cmd pull /system/bin/app_process obj/local/armeabi-v7a/app_process
89 KB/s (5736 bytes in 0.062s)
Pulled app_process from device/emulator.
## COMMAND: adb_cmd pull /system/bin/linker obj/local/armeabi-v7a/linker
2468 KB/s (39436 bytes in 0.015s)
Pulled linker from device/emulator.
## COMMAND: adb_cmd pull /system/lib/libc.so obj/local/armeabi-v7a/libc.so
5943 KB/s (273912 bytes in 0.045s)
Pulled libc.so from device/emulator.
/cygdrive/e/rect/android-ndk-r9c/ndk-gdb: line 770: [: armeabi-v7a: unary operator expected
GNU gdb (GDB) 7.3.1-gg2
License GPLv3+: GNU GPL version 3 or later
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "--host=x86_64-pc-mingw32msvc --target=arm-linux-android".
For bug reporting instructions, please see:
.
Warning: E:/rect/SrcClient/lua/proj.android/../../../cocos2dx: No such file or directory.
Warning: E:/rect/SrcClient/lua/proj.android/../../../cocos2dx/include: No such file or directory.
Warning: E:/rect/SrcClient/lua/proj.android/../../../cocos2dx/platform: No such file or directory.
Warning: E:/rect/SrcClient/lua/proj.android/../../../cocos2dx/platform/android: No such file or directory.
Warning: E:/rect/SrcClient/lua/proj.android/../../../cocos2dx/kazmath/include: No such file or directory.
Warning: E:/rect/SrcClient/lua/proj.android/../../../CocosDenshion/include: No such file or directory.
Warning: E:/rect/SrcClient/lua/proj.android/../../../extensions: No such file or directory.
Warning: E:/rect/SrcClient/BaseCore/../../../include: No such file or directory.
Warning: E:/rect/SrcClient/BaseCore/../../../Common: No such file or directory.
Warning: E:/rect/SrcClient/BaseCore/filesystembzip2: No such file or directory.
Warning: E:/rect/SrcClient/GameWnd/GameWnd: No such file or directory.
Warning: E:/rect/SrcClient/EmBattleClient/Classes: No such file or directory.
Warning: E:/rect/SrcClient/ArenaClient/Classes: No such file or directory.
Warning: E:/rect/SrcClient/CardSystem/Classes: No such file or directory.
Warning: E:/rect/SrcClient/DramaticClient/Classes: No such file or directory.
Warning: E:/rect/SrcClient/EntityClient/Classes: No such file or directory.
Warning: E:/rect/SrcClient/FightSystem/Classes: No such file or directory.
Warning: E:/rect/SrcClient/ShipClient/Classes: No such file or directory.
Warning: E:/rect/SrcClient/WorldBossClient/Classes: No such file or directory.
Warning: E:/rect/SrcClient/Log/Classes: No such file or directory.
Warning: E:\rect\SrcClient\Game\proj.android/jni/../../../../../Common: No such file or directory.
Warning: E:\rect\SrcClient\Game\proj.android/jni/../../../../../Include: No such file or directory.
Warning: E:/rect/SrcClient/engine/inc/common: No such file or directory.
Warning: E:/rect/SrcClient/engine/inc/common/jsons: No such file or directory.
Warning: E:/rect/SrcClient/engine/inc/engine: No such file or directory.
Warning: E:/rect/SrcClient/engine/inc/render: No such file or directory.
Warning: E:/rect/SrcClient/SkillSystem/GameWnd: No such file or directory.
(gdb) obj/local/armeabi-v7a/gdb.setup:4: Error in sourced command file:
Remote communication error. Target disconnected.: No error.

复制代码

最后的一堆Warning 生成的都是错乱的路径.但是仔细看其实这是两个错误, 一个是错误路径,一个是无效路径.

解决

1.修改所有android.mk 把无效的源码路径全部去掉,大概修改了二十多个地方.
2.对于几个错乱的路径用完整路径代替.

关于这个gdb.setup的路径生成BUG 我提在stackoverflowndk-gdb的问题解决了之后再次运行调试命令.运行之后输入

continue

复制代码

该命令和VS的F5无意.然后把之前的项目BUG设法重现.终于最后获取了最实在的堆栈信息:

[New Thread 4285]
Program received signal SIGSEGV, Segmentation fault.
[Switching to Thread 4285]
0x400926a8 in ?? () from E:/rect/SrcClient/Game/proj.android/obj/local/armeabi-v7a/libc.so
(gdb) bt
#0 0x400926a8 in ?? () from E:/rect/SrcClient/Game/proj.android/obj/local/armeabi-v7a/libc.so
#1 0x40089614 in dlmalloc_inspect_all () from E:/rect/SrcClient/Game/proj.android/obj/local/armeabi-v7a/libc.so
#2 0x41613a6c in ?? ()
#3 0x41613a6c in ?? ()
Backtrace stopped: previous frame identical to this frame (corrupt stack?)