Uploaded image for project: 'PuppetDB'
  1. PuppetDB
  2. PDB-1516

shutdown sometimes stalls causing failure on restart

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Normal
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: PDB 3.0.0
    • Component/s: None
    • Labels:
      None
    • Template:
    • Story Points:
      2
    • Sprint:
      PuppetDB 2015-06-03

      Description

      Sometimes when I run PDB from source and shut it down with ctrl-c, the service appears to stop in the console, but when I restart I get the address already in use error:

      2015-05-11 11:15:49,768 ERROR [p.t.internal] Error during service init!!!
      java.net.BindException: Address already in use
      

      I have experienced this a lot recently – not sure yet how to reproduce it or when the regression occurred. I'm pretty sure it's a regression since 2.3.x – would suspect the AMQ changes but again, no clue.

      Looking at my logs for some context, I see this:

      2015-05-11 11:15:26,318 INFO  [p.t.internal] Shutting down due to JVM shutdown hook.
      2015-05-11 11:15:26,320 INFO  [p.t.internal] Beginning shutdown sequence
      2015-05-11 11:15:26,334 INFO  [p.p.c.services] Shutdown request received; puppetdb exiting.
      2015-05-11 11:15:26,335 INFO  [p.p.c.services] Shutting down updater thread.
      2015-05-11 11:15:26,335 INFO  [p.p.c.services] Shutting down the messsage queues.
      2015-05-11 11:15:27,041 INFO  [c.j.b.BoneCP] Shutting down connection pool...
      2015-05-11 11:15:27,045 INFO  [c.j.b.BoneCP] Connection pool has been shutdown.
      2015-05-11 11:15:27,045 INFO  [c.j.b.BoneCP] Shutting down connection pool...
      2015-05-11 11:15:27,048 INFO  [c.j.b.BoneCP] Connection pool has been shutdown.
      2015-05-11 11:15:27,048 INFO  [p.t.s.w.jetty9-service] Shutting down web server(s).
      2015-05-11 11:15:27,050 INFO  [p.t.s.w.jetty9-core] Shutting down web server.
      2015-05-11 11:15:48,487 DEBUG [p.t.logging] Debug logging enabled
      2015-05-11 11:15:48,490 DEBUG [p.t.bootstrap] Loading bootstrap config from classpath: 'file:/Users/wyatt/Documents/puppetdb/resources/puppetlabs/puppetdb/bootstrap.cfg'
      2015-05-11 11:15:48,742 DEBUG [o.e.j.u.log] Logging to Logger[org.eclipse.jetty.util.log] via org.eclipse.jetty.util.log.Slf4jLog
      2015-05-11 11:15:48,745 INFO  [o.e.j.u.log] Logging initialized @12291ms
      2015-05-11 11:15:49,758 INFO  [p.t.s.n.nrepl-service] Starting nREPL service on 127.0.0.1 port 8082
      2015-05-11 11:15:49,768 ERROR [p.t.internal] Error during service init!!!
      java.net.BindException: Address already in use
      

      The JVM shutdown hook is my ctrl-c. That prompts the beginning of the shutdown sequence. Note that there is no line that says "Finished shutdown sequence", which is what we normally expect. This is where things are going wrong, but the logging doesn't give much info on exactly what this issue is.

      Instead, when I restart the service 20 seconds later, logging gets initialized but the service fails to connect to port 8082 because it didn't actually shut down previously. This occurred with only three reports in my database (and the service stopped naturally after a bit longer), but anecdotally I notice it much more frequently and for durations much longer than 20 seconds with a loaded database in which case I usually need to manually kill it.

      Here is the complete log of the initial shutdown hook, shutdown failure, restart failure, and subsequent successful restart:

      2015-05-11 11:15:26,318 INFO  [p.t.internal] Shutting down due to JVM shutdown hook.
      2015-05-11 11:15:26,320 INFO  [p.t.internal] Beginning shutdown sequence
      2015-05-11 11:15:26,334 INFO  [p.p.c.services] Shutdown request received; puppetdb exiting.
      2015-05-11 11:15:26,335 INFO  [p.p.c.services] Shutting down updater thread.
      2015-05-11 11:15:26,335 INFO  [p.p.c.services] Shutting down the messsage queues.
      2015-05-11 11:15:27,041 INFO  [c.j.b.BoneCP] Shutting down connection pool...
      2015-05-11 11:15:27,045 INFO  [c.j.b.BoneCP] Connection pool has been shutdown.
      2015-05-11 11:15:27,045 INFO  [c.j.b.BoneCP] Shutting down connection pool...
      2015-05-11 11:15:27,048 INFO  [c.j.b.BoneCP] Connection pool has been shutdown.
      2015-05-11 11:15:27,048 INFO  [p.t.s.w.jetty9-service] Shutting down web server(s).
      2015-05-11 11:15:27,050 INFO  [p.t.s.w.jetty9-core] Shutting down web server.
      2015-05-11 11:15:48,487 DEBUG [p.t.logging] Debug logging enabled
      2015-05-11 11:15:48,490 DEBUG [p.t.bootstrap] Loading bootstrap config from classpath: 'file:/Users/wyatt/Documents/puppetdb/resources/puppetlabs/puppetdb/bootstrap.cfg'
      2015-05-11 11:15:48,742 DEBUG [o.e.j.u.log] Logging to Logger[org.eclipse.jetty.util.log] via org.eclipse.jetty.util.log.Slf4jLog
      2015-05-11 11:15:48,745 INFO  [o.e.j.u.log] Logging initialized @12291ms
      2015-05-11 11:15:49,758 INFO  [p.t.s.n.nrepl-service] Starting nREPL service on 127.0.0.1 port 8082
      2015-05-11 11:15:49,768 ERROR [p.t.internal] Error during service init!!!
      java.net.BindException: Address already in use
          at java.net.PlainSocketImpl.socketBind(Native Method) ~[na:1.7.0_60]
          at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:376) ~[na:1.7.0_60]
          at java.net.ServerSocket.bind(ServerSocket.java:376) ~[na:1.7.0_60]
          at java.net.ServerSocket.<init>(ServerSocket.java:237) ~[na:1.7.0_60]
          at clojure.tools.nrepl.server$start_server.doInvoke(server.clj:134) ~[na:na]
          at clojure.lang.RestFn.invoke(RestFn.java:512) [clojure-1.7.0-beta2.jar:na]
          at puppetlabs.trapperkeeper.services.nrepl.nrepl_service$startup_nrepl.invoke(nrepl_service.clj:39) ~[na:na]
          at puppetlabs.trapperkeeper.services.nrepl.nrepl_service$reify__27592$service_fnk__13514__auto___positional$reify__27599.init(nrepl_service.clj:61) ~[na:na]
          at puppetlabs.trapperkeeper.services$eval13350$fn__13351$G__13338__13354.invoke(services.clj:8) ~[na:na]
          at puppetlabs.trapperkeeper.services$eval13350$fn__13351$G__13337__13358.invoke(services.clj:8) ~[na:na]
          at puppetlabs.trapperkeeper.internal$run_lifecycle_fn_BANG_.invoke(internal.clj:152) ~[na:na]
          at puppetlabs.trapperkeeper.internal$run_lifecycle_fns.invoke(internal.clj:180) ~[na:na]
          at puppetlabs.trapperkeeper.internal$build_app_STAR_$reify__21312.init(internal.clj:444) [na:na]
          at puppetlabs.trapperkeeper.internal$boot_services_STAR_$fn__21324.invoke(internal.clj:470) [na:na]
          at puppetlabs.trapperkeeper.internal$boot_services_STAR_.invoke(internal.clj:469) [na:na]
          at puppetlabs.trapperkeeper.core$boot_with_cli_data.invoke(core.clj:115) [na:na]
          at puppetlabs.trapperkeeper.core$run.invoke(core.clj:144) [na:na]
          at puppetlabs.trapperkeeper.core$main.doInvoke(core.clj:161) [na:na]
          at clojure.lang.RestFn.applyTo(RestFn.java:137) [clojure-1.7.0-beta2.jar:na]
          at clojure.core$apply.invoke(core.clj:628) [clojure-1.7.0-beta2.jar:na]
          at puppetlabs.puppetdb.cli.services$_main.doInvoke(services.clj:386) [na:na]
          at clojure.lang.RestFn.invoke(RestFn.java:436) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Var.invoke(Var.java:388) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.AFn.applyToHelper(AFn.java:160) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Var.applyTo(Var.java:700) [clojure-1.7.0-beta2.jar:na]
          at clojure.core$apply.invoke(core.clj:628) [clojure-1.7.0-beta2.jar:na]
          at puppetlabs.puppetdb.core$run_command.invoke(core.clj:83) [na:na]
          at puppetlabs.puppetdb.core$_main.doInvoke(core.clj:91) [na:na]
          at clojure.lang.RestFn.invoke(RestFn.java:457) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Var.invoke(Var.java:394) [clojure-1.7.0-beta2.jar:na]
          at user$eval796.invoke(form-init2821110943593815744.clj:1) [na:na]
          at clojure.lang.Compiler.eval(Compiler.java:6792) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Compiler.eval(Compiler.java:6782) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Compiler.load(Compiler.java:7237) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Compiler.loadFile(Compiler.java:7175) [clojure-1.7.0-beta2.jar:na]
          at clojure.main$load_script.invoke(main.clj:275) [clojure-1.7.0-beta2.jar:na]
          at clojure.main$init_opt.invoke(main.clj:280) [clojure-1.7.0-beta2.jar:na]
          at clojure.main$initialize.invoke(main.clj:308) [clojure-1.7.0-beta2.jar:na]
          at clojure.main$null_opt.invoke(main.clj:343) [clojure-1.7.0-beta2.jar:na]
          at clojure.main$main.doInvoke(main.clj:421) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.RestFn.invoke(RestFn.java:421) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Var.invoke(Var.java:383) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.AFn.applyToHelper(AFn.java:156) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Var.applyTo(Var.java:700) [clojure-1.7.0-beta2.jar:na]
          at clojure.main.main(main.java:37) [clojure-1.7.0-beta2.jar:na]
      2015-05-11 11:15:49,771 INFO  [p.t.internal] Beginning shutdown sequence
      2015-05-11 11:15:49,773 ERROR [p.t.internal] Encountered error during shutdown sequence
      java.lang.NullPointerException: null
          at clojure.lang.Reflector.invokeNoArgInstanceMember(Reflector.java:301) ~[clojure-1.7.0-beta2.jar:na]
          at puppetlabs.puppetdb.mq_listener$reify__26679$service_fnk__13514__auto___positional$reify__26689.stop(mq_listener.clj:388) ~[na:na]
          at puppetlabs.trapperkeeper.services$eval13350$fn__13377$G__13342__13380.invoke(services.clj:8) ~[na:na]
          at puppetlabs.trapperkeeper.services$eval13350$fn__13377$G__13341__13384.invoke(services.clj:8) ~[na:na]
          at puppetlabs.trapperkeeper.internal$run_lifecycle_fn_BANG_.invoke(internal.clj:152) ~[na:na]
          at puppetlabs.trapperkeeper.internal$shutdown_BANG_$fn__21276.invoke(internal.clj:320) ~[na:na]
          at puppetlabs.trapperkeeper.internal$shutdown_BANG_.invoke(internal.clj:319) [na:na]
          at puppetlabs.trapperkeeper.core$run_app.invoke(core.clj:133) [na:na]
          at puppetlabs.trapperkeeper.core$run.invoke(core.clj:148) [na:na]
          at puppetlabs.trapperkeeper.core$main.doInvoke(core.clj:161) [na:na]
          at clojure.lang.RestFn.applyTo(RestFn.java:137) [clojure-1.7.0-beta2.jar:na]
          at clojure.core$apply.invoke(core.clj:628) [clojure-1.7.0-beta2.jar:na]
          at puppetlabs.puppetdb.cli.services$_main.doInvoke(services.clj:386) [na:na]
          at clojure.lang.RestFn.invoke(RestFn.java:436) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Var.invoke(Var.java:388) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.AFn.applyToHelper(AFn.java:160) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Var.applyTo(Var.java:700) [clojure-1.7.0-beta2.jar:na]
          at clojure.core$apply.invoke(core.clj:628) [clojure-1.7.0-beta2.jar:na]
          at puppetlabs.puppetdb.core$run_command.invoke(core.clj:83) [na:na]
          at puppetlabs.puppetdb.core$_main.doInvoke(core.clj:91) [na:na]
          at clojure.lang.RestFn.invoke(RestFn.java:457) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Var.invoke(Var.java:394) [clojure-1.7.0-beta2.jar:na]
          at user$eval796.invoke(form-init2821110943593815744.clj:1) [na:na]
          at clojure.lang.Compiler.eval(Compiler.java:6792) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Compiler.eval(Compiler.java:6782) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Compiler.load(Compiler.java:7237) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Compiler.loadFile(Compiler.java:7175) [clojure-1.7.0-beta2.jar:na]
          at clojure.main$load_script.invoke(main.clj:275) [clojure-1.7.0-beta2.jar:na]
          at clojure.main$init_opt.invoke(main.clj:280) [clojure-1.7.0-beta2.jar:na]
          at clojure.main$initialize.invoke(main.clj:308) [clojure-1.7.0-beta2.jar:na]
          at clojure.main$null_opt.invoke(main.clj:343) [clojure-1.7.0-beta2.jar:na]
          at clojure.main$main.doInvoke(main.clj:421) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.RestFn.invoke(RestFn.java:421) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Var.invoke(Var.java:383) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.AFn.applyToHelper(AFn.java:156) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Var.applyTo(Var.java:700) [clojure-1.7.0-beta2.jar:na]
          at clojure.main.main(main.java:37) [clojure-1.7.0-beta2.jar:na]
      2015-05-11 11:15:49,774 INFO  [p.p.c.services] Shutdown request received; puppetdb exiting.
      2015-05-11 11:15:49,775 INFO  [p.t.s.w.jetty9-service] Shutting down web server(s).
      2015-05-11 11:15:49,777 INFO  [p.t.internal] Finished shutdown sequence
      2015-05-11 11:15:49,785 ERROR [p.t.logging] Uncaught exception
      java.net.BindException: Address already in use
          at java.net.PlainSocketImpl.socketBind(Native Method) ~[na:1.7.0_60]
          at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:376) ~[na:1.7.0_60]
          at java.net.ServerSocket.bind(ServerSocket.java:376) ~[na:1.7.0_60]
          at java.net.ServerSocket.<init>(ServerSocket.java:237) ~[na:1.7.0_60]
          at clojure.tools.nrepl.server$start_server.doInvoke(server.clj:134) ~[na:na]
          at clojure.lang.RestFn.invoke(RestFn.java:512) [clojure-1.7.0-beta2.jar:na]
          at puppetlabs.trapperkeeper.services.nrepl.nrepl_service$startup_nrepl.invoke(nrepl_service.clj:39) ~[na:na]
          at puppetlabs.trapperkeeper.services.nrepl.nrepl_service$reify__27592$service_fnk__13514__auto___positional$reify__27599.init(nrepl_service.clj:61) ~[na:na]
          at puppetlabs.trapperkeeper.services$eval13350$fn__13351$G__13338__13354.invoke(services.clj:8) ~[na:na]
          at puppetlabs.trapperkeeper.services$eval13350$fn__13351$G__13337__13358.invoke(services.clj:8) ~[na:na]
          at puppetlabs.trapperkeeper.internal$run_lifecycle_fn_BANG_.invoke(internal.clj:152) ~[na:na]
          at puppetlabs.trapperkeeper.internal$run_lifecycle_fns.invoke(internal.clj:180) ~[na:na]
          at puppetlabs.trapperkeeper.internal$build_app_STAR_$reify__21312.init(internal.clj:444) ~[na:na]
          at puppetlabs.trapperkeeper.internal$boot_services_STAR_$fn__21324.invoke(internal.clj:470) ~[na:na]
          at puppetlabs.trapperkeeper.internal$boot_services_STAR_.invoke(internal.clj:469) ~[na:na]
          at puppetlabs.trapperkeeper.core$boot_with_cli_data.invoke(core.clj:115) ~[na:na]
          at puppetlabs.trapperkeeper.core$run.invoke(core.clj:144) ~[na:na]
          at puppetlabs.trapperkeeper.core$main.doInvoke(core.clj:161) ~[na:na]
          at clojure.lang.RestFn.applyTo(RestFn.java:137) [clojure-1.7.0-beta2.jar:na]
          at clojure.core$apply.invoke(core.clj:628) ~[clojure-1.7.0-beta2.jar:na]
          at puppetlabs.puppetdb.cli.services$_main.doInvoke(services.clj:386) ~[na:na]
          at clojure.lang.RestFn.invoke(RestFn.java:436) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Var.invoke(Var.java:388) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.AFn.applyToHelper(AFn.java:160) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Var.applyTo(Var.java:700) [clojure-1.7.0-beta2.jar:na]
          at clojure.core$apply.invoke(core.clj:628) ~[clojure-1.7.0-beta2.jar:na]
          at puppetlabs.puppetdb.core$run_command.invoke(core.clj:83) ~[na:na]
          at puppetlabs.puppetdb.core$_main.doInvoke(core.clj:91) [na:na]
          at clojure.lang.RestFn.invoke(RestFn.java:457) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Var.invoke(Var.java:394) [clojure-1.7.0-beta2.jar:na]
          at user$eval796.invoke(form-init2821110943593815744.clj:1) [na:na]
          at clojure.lang.Compiler.eval(Compiler.java:6792) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Compiler.eval(Compiler.java:6782) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Compiler.load(Compiler.java:7237) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Compiler.loadFile(Compiler.java:7175) [clojure-1.7.0-beta2.jar:na]
          at clojure.main$load_script.invoke(main.clj:275) [clojure-1.7.0-beta2.jar:na]
          at clojure.main$init_opt.invoke(main.clj:280) [clojure-1.7.0-beta2.jar:na]
          at clojure.main$initialize.invoke(main.clj:308) [clojure-1.7.0-beta2.jar:na]
          at clojure.main$null_opt.invoke(main.clj:343) [clojure-1.7.0-beta2.jar:na]
          at clojure.main$main.doInvoke(main.clj:421) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.RestFn.invoke(RestFn.java:421) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Var.invoke(Var.java:383) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.AFn.applyToHelper(AFn.java:156) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Var.applyTo(Var.java:700) [clojure-1.7.0-beta2.jar:na]
          at clojure.main.main(main.java:37) [clojure-1.7.0-beta2.jar:na]
      2015-05-11 11:15:57,062 INFO  [o.e.j.s.ServerConnector] Stopped ServerConnector@5270e941{HTTP/1.1}{0.0.0.0:8080}
      2015-05-11 11:15:57,063 INFO  [o.e.j.s.ServerConnector] Stopped ServerConnector@14de1565{SSL-HTTP/1.1}{0.0.0.0:8081}
      2015-05-11 11:15:57,063 INFO  [o.e.j.s.h.ContextHandler] Stopped o.e.j.s.h.ContextHandler@5412473e{/metrics,null,UNAVAILABLE}
      2015-05-11 11:15:57,063 INFO  [o.e.j.s.h.ContextHandler] Stopped o.e.j.s.h.ContextHandler@1c9bab06{/,null,UNAVAILABLE}
      2015-05-11 11:16:12,070 WARN  [o.e.j.u.c.AbstractLifeCycle] FAILED org.eclipse.jetty.server.Server@74794dc7: java.util.concurrent.TimeoutException
      java.util.concurrent.TimeoutException: null
          at org.eclipse.jetty.util.FutureCallback.get(FutureCallback.java:128) ~[jetty-util-9.2.10.v20150310.jar:9.2.10.v20150310]
          at org.eclipse.jetty.util.FutureCallback.get(FutureCallback.java:30) ~[jetty-util-9.2.10.v20150310.jar:9.2.10.v20150310]
          at org.eclipse.jetty.server.Server.doStop(Server.java:426) ~[jetty-server-9.2.10.v20150310.jar:9.2.10.v20150310]
          at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89) ~[jetty-util-9.2.10.v20150310.jar:9.2.10.v20150310]
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.7.0_60]
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[na:1.7.0_60]
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_60]
          at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_60]
          at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93) [clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Reflector.invokeNoArgInstanceMember(Reflector.java:313) [clojure-1.7.0-beta2.jar:na]
          at puppetlabs.trapperkeeper.services.webserver.jetty9_core$eval24949$shutdown__24950$fn__24951.invoke(jetty9_core.clj:547) [na:na]
          at puppetlabs.trapperkeeper.services.webserver.jetty9_core$eval24949$shutdown__24950.invoke(jetty9_core.clj:543) [na:na]
          at puppetlabs.trapperkeeper.services.webserver.jetty9_service$reify__25641$service_fnk__13514__auto___positional$reify__25648.stop(jetty9_service.clj:49) [na:na]
          at puppetlabs.trapperkeeper.services$eval13350$fn__13377$G__13342__13380.invoke(services.clj:8) [na:na]
          at puppetlabs.trapperkeeper.services$eval13350$fn__13377$G__13341__13384.invoke(services.clj:8) [na:na]
          at puppetlabs.trapperkeeper.internal$run_lifecycle_fn_BANG_.invoke(internal.clj:152) [na:na]
          at puppetlabs.trapperkeeper.internal$shutdown_BANG_$fn__21276.invoke(internal.clj:320) [na:na]
          at puppetlabs.trapperkeeper.internal$shutdown_BANG_.invoke(internal.clj:319) [na:na]
          at puppetlabs.trapperkeeper.internal$initialize_shutdown_service_BANG_$fn__21286.invoke(internal.clj:335) [na:na]
          at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0-beta2.jar:na]
          at java.lang.Thread.run(Thread.java:745) [na:1.7.0_60]
      2015-05-11 11:16:12,071 ERROR [p.t.internal] Encountered error during shutdown sequence
      java.util.concurrent.TimeoutException: null
          at org.eclipse.jetty.util.FutureCallback.get(FutureCallback.java:128) ~[jetty-util-9.2.10.v20150310.jar:9.2.10.v20150310]
          at org.eclipse.jetty.util.FutureCallback.get(FutureCallback.java:30) ~[jetty-util-9.2.10.v20150310.jar:9.2.10.v20150310]
          at org.eclipse.jetty.server.Server.doStop(Server.java:426) ~[jetty-server-9.2.10.v20150310.jar:9.2.10.v20150310]
          at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89) ~[jetty-util-9.2.10.v20150310.jar:9.2.10.v20150310]
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.7.0_60]
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[na:1.7.0_60]
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_60]
          at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_60]
          at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93) ~[clojure-1.7.0-beta2.jar:na]
          at clojure.lang.Reflector.invokeNoArgInstanceMember(Reflector.java:313) ~[clojure-1.7.0-beta2.jar:na]
          at puppetlabs.trapperkeeper.services.webserver.jetty9_core$eval24949$shutdown__24950$fn__24951.invoke(jetty9_core.clj:547) ~[na:na]
          at puppetlabs.trapperkeeper.services.webserver.jetty9_core$eval24949$shutdown__24950.invoke(jetty9_core.clj:543) ~[na:na]
          at puppetlabs.trapperkeeper.services.webserver.jetty9_service$reify__25641$service_fnk__13514__auto___positional$reify__25648.stop(jetty9_service.clj:49) ~[na:na]
          at puppetlabs.trapperkeeper.services$eval13350$fn__13377$G__13342__13380.invoke(services.clj:8) ~[na:na]
          at puppetlabs.trapperkeeper.services$eval13350$fn__13377$G__13341__13384.invoke(services.clj:8) ~[na:na]
          at puppetlabs.trapperkeeper.internal$run_lifecycle_fn_BANG_.invoke(internal.clj:152) ~[na:na]
          at puppetlabs.trapperkeeper.internal$shutdown_BANG_$fn__21276.invoke(internal.clj:320) ~[na:na]
          at puppetlabs.trapperkeeper.internal$shutdown_BANG_.invoke(internal.clj:319) [na:na]
          at puppetlabs.trapperkeeper.internal$initialize_shutdown_service_BANG_$fn__21286.invoke(internal.clj:335) [na:na]
          at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0-beta2.jar:na]
          at java.lang.Thread.run(Thread.java:745) [na:1.7.0_60]
      2015-05-11 11:16:12,072 INFO  [p.t.s.n.nrepl-service] Shutting down nREPL service
      2015-05-11 11:16:12,074 INFO  [p.t.internal] Finished shutdown sequence
      2015-05-11 11:16:34,864 DEBUG [p.t.logging] Debug logging enabled
      2015-05-11 11:16:34,867 DEBUG [p.t.bootstrap] Loading bootstrap config from classpath: 'file:/Users/wyatt/Documents/puppetdb/resources/puppetlabs/puppetdb/bootstrap.cfg'
      2015-05-11 11:16:35,122 DEBUG [o.e.j.u.log] Logging to Logger[org.eclipse.jetty.util.log] via org.eclipse.jetty.util.log.Slf4jLog
      2015-05-11 11:16:35,124 INFO  [o.e.j.u.log] Logging initialized @12233ms
      2015-05-11 11:16:36,107 INFO  [p.t.s.n.nrepl-service] Starting nREPL service on 127.0.0.1 port 8082
      2015-05-11 11:16:36,114 INFO  [p.t.s.w.jetty9-service] Initializing web server(s).
      2015-05-11 11:16:36,122 INFO  [p.t.s.w.jetty9-service] Starting web server(s).
      

        Attachments

          Activity

            People

            • Assignee:
              wyatt Wyatt Alt
              Reporter:
              wyatt Wyatt Alt
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Zendesk Support