Corrupt database
Hi,
we're experiencing a strange problem, after upgrading Youtrack from 2017.2.x (worked flawlessly) to 2018.2.x sometimes Youtrack stops working and after attempting to restart it it complains about the database being ciphered (see below). It has happened three times now and after that we manually restore it from previous day's backups.
Do you know what could cause this ? Perhaps heavy CPU loads during nightly backups of the server ?
We want the application to perform flawlessly as it did before so we'll create a brand new installation using a Docker image. But if we did something wrong we'd like to know to avoid it in the future.
thanks,Rok
[2018-07-25 08:00:01,133] [YouTrack Error] [2018-07-25 08:00:01,126] WARN - pse.jetty.webapp.WebAppContext - Failed startup of context o.e.j.w.WebAppContext@3df7711f{/hub,file:///root/.youtrack/app/apps/hub/web/,UNAVAILABLE}
[2018-07-25 08:00:01,133] [YouTrack Error] jetbrains.exodus.crypto.InvalidCipherParametersException: Database is ciphered with different/unknown cipher parameters
[2018-07-25 08:00:01,133] [YouTrack Error] at jetbrains.exodus.log.Log.<init>(Log.java:163) ~[?:?]
[2018-07-25 08:00:01,134] [YouTrack Error] at jetbrains.exodus.env.Environments.newLogInstance(Environments.java:137) ~[?:?]
[2018-07-25 08:00:01,134] [YouTrack Error] at jetbrains.exodus.env.Environments.newLogInstance(Environments.java:115) ~[?:?]
[2018-07-25 08:00:01,134] [YouTrack Error] at jetbrains.exodus.env.Environments.newLogInstance(Environments.java:104) ~[?:?]
[2018-07-25 08:00:01,134] [YouTrack Error] at jetbrains.jetpass.server.main.EnvironmentFactory.createEnvironment(EnvironmentFactory.kt:50) ~[?:?]
[2018-07-25 08:00:01,134] [YouTrack Error] at jetbrains.hub.server.listener.MigrationServletContextListener.contextInitialized(MigrationServletContextListener.kt:15) ~[?:?]
[2018-07-25 08:00:01,134] [YouTrack Error] at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:843) ~[jetty-server-9.3.20.v20170531.jar:9.3.20.v20170531]
[2018-07-25 08:00:01,134] [YouTrack Error] at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:533) ~[jetty-servlet-9.3.20.v20170531.jar:9.3.20.v20170531]
[2018-07-25 08:00:01,134] [YouTrack Error] at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:816) ~[jetty-server-9.3.20.v20170531.jar:9.3.20.v20170531]
[2018-07-25 08:00:01,135] [YouTrack Error] at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:345) ~[jetty-servlet-9.3.20.v20170531.jar:9.3.20.v20170531]
[2018-07-25 08:00:01,135] [YouTrack Error] at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1406) ~[jetty-webapp-9.3.20.v20170531.jar:9.3.20.v20170531]
[2018-07-25 08:00:01,135] [YouTrack Error] at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1368) ~[jetty-webapp-9.3.20.v20170531.jar:9.3.20.v20170531]
[2018-07-25 08:00:01,135] [YouTrack Error] at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:778) ~[jetty-server-9.3.20.v20170531.jar:9.3.20.v20170531]
[2018-07-25 08:00:01,136] [YouTrack Error] at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:262) ~[jetty-servlet-9.3.20.v20170531.jar:9.3.20.v20170531]
[2018-07-25 08:00:01,136] [YouTrack Error] at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:522) [jetty-webapp-9.3.20.v20170531.jar:9.3.20.v20170531]
[2018-07-25 08:00:01,136] [YouTrack Error] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) [jetty-util-9.3.20.v20170531.jar:9.3.20.v20170531]
[2018-07-25 08:00:01,136] [YouTrack Error] at com.jetbrains.bundle.services.impl.jetty.BundleJettyServicesContainer.startContextInContainer(BundleJettyServicesContainer.java:92) [bundle-1.4.181.jar:?]
[2018-07-25 08:00:01,136] [YouTrack Error] at com.jetbrains.bundle.services.impl.jetty.BundleJettyServicesContainer.startServiceInContainer(BundleJettyServicesContainer.java:74) [bundle-1.4.181.jar:?]
[2018-07-25 08:00:01,136] [YouTrack Error] at com.jetbrains.bundle.services.impl.BundledService.doStart(BundledService.java:55) [bundle-1.4.181.jar:?]
[2018-07-25 08:00:01,136] [YouTrack Error] at com.jetbrains.bundle.services.impl.ServiceBase.start(ServiceBase.java:65) [bundle-1.4.181.jar:?]
[2018-07-25 08:00:01,136] [YouTrack Error] at com.jetbrains.bundle.Services.startService(Services.java:627) [bundle-1.4.181.jar:?]
[2018-07-25 08:00:01,136] [YouTrack Error] at com.jetbrains.bundle.Services.startAllServices(Services.java:554) [bundle-1.4.181.jar:?]
[2018-07-25 08:00:01,136] [YouTrack Error] at com.jetbrains.bundle.Services.start(Services.java:534) [bundle-1.4.181.jar:?]
[2018-07-25 08:00:01,136] [YouTrack Error] at com.jetbrains.bundle.BundleMain.start(BundleMain.java:208) [bundle-1.4.181.jar:?]
[2018-07-25 08:00:01,136] [YouTrack Error] at com.jetbrains.bundle.BundleMain.start(BundleMain.java:167) [bundle-1.4.181.jar:?]
[2018-07-25 08:00:01,136] [YouTrack Error] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_162]
[2018-07-25 08:00:01,136] [YouTrack Error] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_162]
[2018-07-25 08:00:01,136] [YouTrack Error] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_162]
[2018-07-25 08:00:01,136] [YouTrack Error] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_162]
[2018-07-25 08:00:01,136] [YouTrack Error] at com.jetbrains.bundle.bootstrap.Bundle$EntryPointProvider$1.invoke(Bundle.java:92) [bundle-bootstrap-1.4.181.jar:?]
[2018-07-25 08:00:01,136] [YouTrack Error] at com.sun.proxy.$Proxy18.start(Unknown Source) [?:?]
[2018-07-25 08:00:01,136] [YouTrack Error] at com.jetbrains.launcher.AppProxy$6$1.call(AppProxy.java:99) [youtrack-wrapper.jar:1.0.117]
[2018-07-25 08:00:01,136] [YouTrack Error] at com.jetbrains.launcher.AppProxy$6$1.call(AppProxy.java:97) [youtrack-wrapper.jar:1.0.117]
[2018-07-25 08:00:01,136] [YouTrack Error] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_162]
[2018-07-25 08:00:01,136] [YouTrack Error] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_162]
Please sign in to leave a comment.
Could you please create a support ticket for this problem?
Any chance you have insights on possible reasons of the issue?
I've faced similar problem recently. Disk space didn't exhaust (as one of googled results tried to tell me).
This is just a generic error that can be caused by a variety of issues, so there's no single answer. Therefore to find out what happened, we need the details about your specific installation. Given that this is a public forum, create a private support ticket providing the following details:
what exactly happened before this error occurred, e.g., a server crash, server restart, upgrade etc
share an archive of the logs directory. You can upload it to https://uploads.youtrack.cloud
We'll examine these details and get back to you with further information.