参考 并修改
go get github.com/google/gops
go install github.com/google/gops@latest
在命令行输入 gops help, 检测是否安装成功
是Go团队提供的命令行工具,它可以用来获取go进程运行时信息。
可以查看:
可以获取:
还可以:
示例代码
使用Options
配置agent。
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 | package main import ( "log" "runtime" "time" "github.com/google/gops/agent" ) func main() { if err := agent.Listen(agent.Options{ Addr: "0.0.0.0:8848", // ConfigDir: "/home/centos/gopsconfig", // 最好使用默认 ShutdownCleanup: true}); err != nil { log.Fatal(err) } // 测试代码 _ = make([]int, 1000, 1000) runtime.GC() _ = make([]int, 1000, 2000) runtime.GC() time.Sleep(time.Hour) } |
agent Option选项
agent有3个配置:
Addr
:agent要监听的ip和端口,默认ip为环回地址,端口随机分配。ConfigDir
:该目录存放的不是agent的配置,而是每一个使用了agent的go进程信息,文件以pid命名,内容是该pid进程所监听的端口号,所以其中文件的目的是形成pid到端口的映射。默认值为~/.config/gops
ShutdownCleanup
:进程退出时,是否清理ConfigDir中的文件,默认值为false,不清理ConfigDir
示例:
1 2 3 4 5 | // gopsconfig为设置的ConfigDir目录,2051为pid,8848为端口号。 ➜ ~ cat gopsconfig/2051 8848% ➜ ~ netstat -nap | grep `pgrep gopsexample` tcp6 0 0 :::8848 :::* LISTEN 2051/./gopsexample |
gops的原理是,代码中导入gops/agent
,建立agent服务,gops命令连接agent
读取进程信息。
agent
的实现原理可以查看agent/handle
。
使用go标准库中原生接口实现相关功能,如同你要在自己的程序中开启pprof类似,只不过这部分功能由gops/agent
实现了:
runtime.MemStats
获取内存情况runtime/pprof
获取调用栈、cpu profile和memory profileruntime/trace
获取traceruntime
获取stats信息runtime/debug
、GC
设置和启动GC再谈ConfigDir
。从源码上看,ConfigDir
对agent并没有用途,对gops有用。当gops和ConfigDir在一台机器上时,即gops查看本机的go进程信息,gops可以通过其中的文件,快速找到agent服务的端口。能够实现:gops <sub-cmd> pid
到gops <sub-cmd> 127.0.0.1:port
的转换。
也可以直接跟pid,查看本机进程信息。
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 | ➜ ~ gops help memstats gops is a tool to list and diagnose Go processes. Usage: gops <cmd> <pid|addr> ... gops <pid> # displays process info gops help # displays this help message Commands: stack Prints the stack trace. gc Runs the garbage collector and blocks until successful. setgc Sets the garbage collection target percentage. memstats Prints the allocation and garbage collection stats. version Prints the Go version used to build the program. stats Prints runtime stats. trace Runs the runtime tracer for 5 secs and launches "go tool trace". pprof-heap Reads the heap profile and launches "go tool pprof". pprof-cpu Reads the CPU profile and launches "go tool pprof". All commands require the agent running on the Go process. "*" indicates the process is running the agent. |
查看当前机器上的go进程,可以列出pid、ppid、进程名、可执行程序所使用的go版本,以及可执行程序的路径。
1 2 3 4 5 6 7 8 | ➜ ~ gops 67292 66333 gops * go1.13 /Users/shitaibin/Workspace/golang_step_by_step/gops/gops 67434 65931 gops go1.13 /Users/shitaibin/go/bin/gops 66551 1 gocode go1.11.2 /Users/shitaibin/go/bin/gocode 137 1 com.docker.vmnetd go1.12.7 /Library/PrivilegedHelperTools/com.docker.vmnetd 811 807 com.docker.backend go1.12.13 /Applications/Docker.app/Contents/MacOS/com.docker.backend 807 746 com.docker.supervisor go1.12.13 /Applications/Docker.app/Contents/MacOS/com.docker.supervisor 810 807 com.docker.driver.amd64-linux go1.12.13 /Applications/Docker.app/Contents/MacOS/com.docker.driver.amd64-linux |
带*
的是程序中使用了gops/agent,不带*
的是普通的go程序。
查看进程树:
1 2 3 4 5 6 7 8 9 10 11 12 13 | ➜ ~ gops tree ... ├── 66333 │ └── [*] 67292 (gops) {go1.13} ├── 1 │ ├── 66551 (gocode) {go1.11.2} │ └── 137 (com.docker.vmnetd) {go1.12.7} ├── 65931 │ └── 67476 (gops) {go1.13} └── 746 └── 807 (com.docker.supervisor) {go1.12.13} ├── 811 (com.docker.backend) {go1.12.13} └── 810 (com.docker.driver.amd64-linux) {go1.12.13} |
查看进程的概要信息,非gops进程也可以:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 | ➜ ~ gops 67292 parent PID: 66333 threads: 7 memory usage: 0.018% cpu usage: 0.000% username: shitaibin cmd+args: ./gops elapsed time: 11:28 local/remote: 127.0.0.1:54753 <-> :0 (LISTEN) ➜ ~ ➜ ~ gops 807 parent PID: 746 threads: 28 memory usage: 0.057% cpu usage: 0.003% username: shitaibin cmd+args: /Applications/Docker.app/Contents/MacOS/com.docker.supervisor -watchdog fd:0 elapsed time: 27-23:36:35 local/remote: 127.0.0.1:54832 <-> :0 () local/remote: *:53849 <-> :0 () local/remote: 127.0.0.1:49473 <-> :0 (LISTEN) |
查看使用gops的进程的调用栈:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 | ➜ ~ gops stack 67292 goroutine 19 [running]: runtime/pprof.writeGoroutineStacks(0x1197160, 0xc00009c028, 0x0, 0x0) /Users/shitaibin/goroot/src/runtime/pprof/pprof.go:679 +0x9d runtime/pprof.writeGoroutine(0x1197160, 0xc00009c028, 0x2, 0x0, 0x0) /Users/shitaibin/goroot/src/runtime/pprof/pprof.go:668 +0x44 runtime/pprof.(*Profile).WriteTo(0x1275c60, 0x1197160, 0xc00009c028, 0x2, 0xc00009c028, 0x0) /Users/shitaibin/goroot/src/runtime/pprof/pprof.go:329 +0x3da github.com/google/gops/agent.handle(0x1665008, 0xc00009c028, 0xc000014068, 0x1, 0x1, 0x0, 0x0) /Users/shitaibin/go/src/github.com/google/gops/agent/agent.go:185 +0x1ab github.com/google/gops/agent.listen() /Users/shitaibin/go/src/github.com/google/gops/agent/agent.go:133 +0x2bf created by github.com/google/gops/agent.Listen /Users/shitaibin/go/src/github.com/google/gops/agent/agent.go:111 +0x364 goroutine 1 [sleep]: runtime.goparkunlock(...) /Users/shitaibin/goroot/src/runtime/proc.go:310 time.Sleep(0x34630b8a000) /Users/shitaibin/goroot/src/runtime/time.go:105 +0x157 main.main() /Users/shitaibin/Workspace/golang_step_by_step/gops/example.go:15 +0xa3 goroutine 18 [syscall]: os/signal.signal_recv(0x0) /Users/shitaibin/goroot/src/runtime/sigqueue.go:144 +0x96 os/signal.loop() /Users/shitaibin/goroot/src/os/signal/signal_unix.go:23 +0x22 created by os/signal.init.0 /Users/shitaibin/goroot/src/os/signal/signal_unix.go:29 +0x41 |
查看gops进程内存使用情况:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 | ➜ ~ gops memstats 67944 alloc: 136.80KB (140088 bytes) // 当前分配出去未收回的内存总量 total-alloc: 152.08KB (155728 bytes) // 已分配出去的内存总量 sys: 67.25MB (70518784 bytes) // 当前进程从OS获取的内存总量 lookups: 0 mallocs: 418 // 分配的对象数量 frees: 82 // 释放的对象数量 heap-alloc: 136.80KB (140088 bytes) // 当前分配出去未收回的堆内存总量 heap-sys: 63.56MB (66650112 bytes) // 当前堆从OS获取的内存 heap-idle: 62.98MB (66035712 bytes) // 当前堆中空闲的内存量 heap-in-use: 600.00KB (614400 bytes) // 当前堆使用中的内存量 heap-released: 62.89MB (65945600 bytes) heap-objects: 336 // 堆中对象数量 stack-in-use: 448.00KB (458752 bytes) // 栈使用中的内存量 stack-sys: 448.00KB (458752 bytes) // 栈从OS获取的内存总量 stack-mspan-inuse: 10.89KB (11152 bytes) stack-mspan-sys: 16.00KB (16384 bytes) stack-mcache-inuse: 13.56KB (13888 bytes) stack-mcache-sys: 16.00KB (16384 bytes) other-sys: 1.01MB (1062682 bytes) gc-sys: 2.21MB (2312192 bytes) next-gc: when heap-alloc >= 4.00MB (4194304 bytes) // 下次GC的条件 last-gc: 2020-03-16 10:06:26.743193 +0800 CST // 上次GC的世界 gc-pause-total: 83.84µs // GC总暂停时间 gc-pause: 44891 // 上次GC暂停时间,单位纳秒 num-gc: 2 // 已进行的GC次数 enable-gc: true // 是否开始GC debug-gc: false |
查看运行时统计信息:
1 2 3 4 5 | ➜ ~ gops stats 68125 goroutines: 3 OS threads: 12 GOMAXPROCS: 8 num CPU: 8 |
获取当前运行5s的trace信息,会打开网页:
1 2 3 4 5 6 | ➜ ~ gops trace 68125 Tracing now, will take 5 secs... Trace dump saved to: /var/folders/5g/rz16gqtx3nsdfs7k8sb80jth0000gn/T/trace116447431 2020/03/16 10:23:37 Parsing trace... 2020/03/16 10:23:37 Splitting trace... 2020/03/16 10:23:37 Opening browser. Trace viewer is listening on http://127.0.0.1:55480 |
获取cpu profile,并进入交互模式:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 | ➜ ~ gops pprof-cpu 68125 Profiling CPU now, will take 30 secs... Profile dump saved to: /var/folders/5g/rz16gqtx3nsdfs7k8sb80jth0000gn/T/profile431166544 Binary file saved to: /var/folders/5g/rz16gqtx3nsdfs7k8sb80jth0000gn/T/binary765361519 File: binary765361519 Type: cpu Time: Mar 16, 2020 at 10:25am (CST) Duration: 30s, Total samples = 0 No samples were found with the default sample value type. Try "sample_index" command to analyze different sample values. Entering interactive mode (type "help" for commands, "o" for options) (pprof) (pprof) top Showing nodes accounting for 0, 0% of 0 total flat flat% sum% cum cum% |
获取memory profile,并进入交互模式:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 | ➜ ~ gops pprof-heap 68125 Profile dump saved to: /var/folders/5g/rz16gqtx3nsdfs7k8sb80jth0000gn/T/profile292136242 Binary file saved to: /var/folders/5g/rz16gqtx3nsdfs7k8sb80jth0000gn/T/binary693335273 File: binary693335273 Type: inuse_space Time: Mar 16, 2020 at 10:27am (CST) No samples were found with the default sample value type. Try "sample_index" command to analyze different sample values. Entering interactive mode (type "help" for commands, "o" for options) (pprof) (pprof) traces File: binary693335273 Type: inuse_space Time: Mar 16, 2020 at 10:27am (CST) -----------+------------------------------------------------------- bytes: 256kB 0 compress/flate.(*compressor).init compress/flate.NewWriter compress/gzip.(*Writer).Write runtime/pprof.(*profileBuilder).build runtime/pprof.profileWriter -----------+------------------------------------------------------- bytes: 64kB 0 compress/flate.newDeflateFast compress/flate.(*compressor).init compress/flate.NewWriter compress/gzip.(*Writer).Write runtime/pprof.(*profileBuilder).build runtime/pprof.profileWriter -----------+------------------------------------------------------- |
1 2 3 4 5 | ➜ ~ sudo netstat -nap | grep 414 ➜ ~ netstat -nap | grep `pgrep gopsexample` (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) tcp 0 0 127.0.0.1:36812 0.0.0.0:* LISTEN 414/./gopsexample |
1 | agent.Listen(agent.Options{Addr:"0.0.0.0:8848"}) |
在远程主机上重新编译、重启进程,确认进程监听的端口:
1 2 3 4 | ➜ ~ netstat -nap | grep `pgrep gopsexample` (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) tcp6 0 0 :::8848 :::* LISTEN 887/./gopsexample |
在本地主机上使用gops连接远端go进程,并查看数据:
1 2 3 4 5 | ➜ ~ gops stats 192.168.9.137:8848 goroutines: 3 OS threads: 9 GOMAXPROCS: 4 num CPU: 4 |
gops
后面只能跟pid查看进程简要信息,不能跟ip和port查看远端go进程简要信息,这些简要信息可以通过子命令汇集起来。
1 2 3 4 5 | ➜ ~ gops 192.168.9.137:8848 gops: unknown subcommand ➜ ~ ➜ ~ gops version 192.168.9.137:8848 go1.13 |