Skip to content

ERROR FunctionInfoProvider failed #545

Description

@danielhanbitlee

Hi,

I downloaded mist and unpacked the tar.gz file. Then, I start mist. I get the following error:

daniel@daniel-K501UX:~/mist-1.1.2$ SPARK_HOME=$SPARK_HOME bin/mist-master start --debug true
19-06-19 17:07:35 [main] INFO ydrosphere.mist.master.Master$:13 Starting mist...
19-06-19 17:07:36 [main] INFO here.mist.master.MasterConfig$:360 Automatically update http.publicHost to 192.168.43.88
19-06-19 17:07:36 [main] INFO here.mist.master.MasterConfig$:360 Automatically update cluster.publicHost to 192.168.43.88
19-06-19 17:07:36 [main] INFO here.mist.master.MasterConfig$:360 Automatically update logs.publicHost to 192.168.43.88
19-06-19 17:07:36 [mist-akka.actor.default-dispatcher-2] INFO akka.event.slf4j.Slf4jLogger:89 Slf4jLogger started
19-06-19 17:07:36 [mist-akka.actor.default-dispatcher-2] INFO akka.remote.Remoting:107 Starting remoting
19-06-19 17:07:36 [mist-akka.actor.default-dispatcher-2] INFO akka.remote.Remoting:107 Remoting started; listening on addresses :[akka.tcp://mist@192.168.43.88:2551]
19-06-19 17:07:36 [main] INFO zaxxer.hikari.HikariDataSource:80 HikariPool-1 - Starting...
19-06-19 17:07:37 [main] INFO zaxxer.hikari.HikariDataSource:82 HikariPool-1 - Start completed.
19-06-19 17:07:37 [main] INFO e.internal.util.VersionPrinter:44 Flyway 4.1.1 by Boxfuse
19-06-19 17:07:37 [main] INFO nal.dbsupport.DbSupportFactory:44 Database: jdbc:h2:file:/home/daniel/Downloads/mist-1.1.2/recovery.db (H2 1.4)
19-06-19 17:07:37 [main] INFO re.internal.command.DbValidate:44 Successfully validated 2 migrations (execution time 00:00.013s)
19-06-19 17:07:37 [main] INFO etadatatable.MetaDataTableImpl:44 Creating Metadata table: "PUBLIC"."schema_version"
19-06-19 17:07:37 [main] INFO ore.internal.command.DbMigrate:44 Current version of schema "PUBLIC": << Empty Schema >>
19-06-19 17:07:37 [main] INFO ore.internal.command.DbMigrate:44 Migrating schema "PUBLIC" to version 1 - Create job details table
19-06-19 17:07:37 [main] INFO ore.internal.command.DbMigrate:44 Migrating schema "PUBLIC" to version 2 - alter table details rename endpoint
19-06-19 17:07:37 [main] INFO ore.internal.command.DbMigrate:44 Successfully applied 2 migrations to schema "PUBLIC" (execution time 00:00.120s).
19-06-19 17:07:37 [ForkJoinPool-1-worker-5] INFO here.mist.master.MasterServer$:270 DB started
19-06-19 17:07:37 [ForkJoinPool-1-worker-3] INFO here.mist.master.MasterServer$:270 LogsSystem started
19-06-19 17:07:40 [ForkJoinPool-1-worker-3] INFO here.mist.master.MasterServer$:270 FunctionInfoProvider started
19-06-19 17:07:41 [ForkJoinPool-1-worker-7] INFO here.mist.master.MasterServer$:270 Main service started
19-06-19 17:07:41 [ForkJoinPool-1-worker-7] INFO here.mist.master.MasterServer$:270 Http interface started
19-06-19 17:07:41 [main] INFO ydrosphere.mist.master.Master$:21 Mist master started
19-06-19 21:55:38 [mist-akka.actor.default-dispatcher-2] WARN akka.remote.RemoteWatcher:131 Detected unreachable: [akka.tcp://mist-info-provider@127.0.0.1:42707]
19-06-19 21:55:38 [mist-akka.actor.default-dispatcher-2] ERROR t.utils.akka.RestartSupervisor:143 Reference for FunctionInfoProvider was terminated. Restarting
19-06-19 21:56:03 [mist-akka.actor.default-dispatcher-2] ERROR t.utils.akka.RestartSupervisor:159 Starting child for FunctionInfoProvider failed
java.lang.IllegalStateException: Initialization of FunctionInfoProvider failed of timeout
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor$$anonfun$receive$1.applyOrElse(FunctionInfoProviderRunner.scala:60)
	at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor.aroundReceive(FunctionInfoProviderRunner.scala:48)
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:527)
	at akka.actor.ActorCell.invoke(ActorCell.scala:496)
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)
	at akka.dispatch.Mailbox.run(Mailbox.scala:224)
	at akka.dispatch.Mailbox.exec(Mailbox.scala:234)
	at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
	at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
	at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
	at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
19-06-19 21:56:28 [mist-akka.actor.default-dispatcher-17] ERROR t.utils.akka.RestartSupervisor:159 Starting child for FunctionInfoProvider failed
java.lang.IllegalStateException: Initialization of FunctionInfoProvider failed of timeout
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor$$anonfun$receive$1.applyOrElse(FunctionInfoProviderRunner.scala:60)
	at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor.aroundReceive(FunctionInfoProviderRunner.scala:48)
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:527)
	at akka.actor.ActorCell.invoke(ActorCell.scala:496)
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)
	at akka.dispatch.Mailbox.run(Mailbox.scala:224)
	at akka.dispatch.Mailbox.exec(Mailbox.scala:234)
	at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
	at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
	at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
	at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
19-06-19 21:56:53 [mist-akka.actor.default-dispatcher-14] ERROR t.utils.akka.RestartSupervisor:159 Starting child for FunctionInfoProvider failed
java.lang.IllegalStateException: Initialization of FunctionInfoProvider failed of timeout
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor$$anonfun$receive$1.applyOrElse(FunctionInfoProviderRunner.scala:60)
	at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor.aroundReceive(FunctionInfoProviderRunner.scala:48)
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:527)
	at akka.actor.ActorCell.invoke(ActorCell.scala:496)
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)
	at akka.dispatch.Mailbox.run(Mailbox.scala:224)
	at akka.dispatch.Mailbox.exec(Mailbox.scala:234)
	at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
	at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
	at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
	at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
19-06-19 21:57:18 [mist-akka.actor.default-dispatcher-17] ERROR t.utils.akka.RestartSupervisor:159 Starting child for FunctionInfoProvider failed
java.lang.IllegalStateException: Initialization of FunctionInfoProvider failed of timeout
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor$$anonfun$receive$1.applyOrElse(FunctionInfoProviderRunner.scala:60)
	at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor.aroundReceive(FunctionInfoProviderRunner.scala:48)
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:527)
	at akka.actor.ActorCell.invoke(ActorCell.scala:496)
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)
	at akka.dispatch.Mailbox.run(Mailbox.scala:224)
	at akka.dispatch.Mailbox.exec(Mailbox.scala:234)
	at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
	at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
	at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
	at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
19-06-19 21:57:44 [mist-akka.actor.default-dispatcher-2] ERROR t.utils.akka.RestartSupervisor:159 Starting child for FunctionInfoProvider failed
java.lang.IllegalStateException: Initialization of FunctionInfoProvider failed of timeout
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor$$anonfun$receive$1.applyOrElse(FunctionInfoProviderRunner.scala:60)
	at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor.aroundReceive(FunctionInfoProviderRunner.scala:48)
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:527)
	at akka.actor.ActorCell.invoke(ActorCell.scala:496)
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)
	at akka.dispatch.Mailbox.run(Mailbox.scala:224)
	at akka.dispatch.Mailbox.exec(Mailbox.scala:234)
	at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
	at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
	at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
	at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
19-06-19 21:58:09 [mist-akka.actor.default-dispatcher-2] ERROR t.utils.akka.RestartSupervisor:159 Starting child for FunctionInfoProvider failed
java.lang.IllegalStateException: Initialization of FunctionInfoProvider failed of timeout
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor$$anonfun$receive$1.applyOrElse(FunctionInfoProviderRunner.scala:60)
	at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor.aroundReceive(FunctionInfoProviderRunner.scala:48)
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:527)
	at akka.actor.ActorCell.invoke(ActorCell.scala:496)
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)
	at akka.dispatch.Mailbox.run(Mailbox.scala:224)
	at akka.dispatch.Mailbox.exec(Mailbox.scala:234)
	at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
	at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
	at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
	at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
19-06-19 21:58:34 [mist-akka.actor.default-dispatcher-2] ERROR t.utils.akka.RestartSupervisor:159 Starting child for FunctionInfoProvider failed
java.lang.IllegalStateException: Initialization of FunctionInfoProvider failed of timeout
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor$$anonfun$receive$1.applyOrElse(FunctionInfoProviderRunner.scala:60)
	at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor.aroundReceive(FunctionInfoProviderRunner.scala:48)
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:527)
	at akka.actor.ActorCell.invoke(ActorCell.scala:496)
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)
	at akka.dispatch.Mailbox.run(Mailbox.scala:224)
	at akka.dispatch.Mailbox.exec(Mailbox.scala:234)
	at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
	at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
	at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
	at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
19-06-19 21:58:59 [mist-akka.actor.default-dispatcher-17] ERROR t.utils.akka.RestartSupervisor:159 Starting child for FunctionInfoProvider failed
java.lang.IllegalStateException: Initialization of FunctionInfoProvider failed of timeout
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor$$anonfun$receive$1.applyOrElse(FunctionInfoProviderRunner.scala:60)
	at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor.aroundReceive(FunctionInfoProviderRunner.scala:48)
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:527)
	at akka.actor.ActorCell.invoke(ActorCell.scala:496)
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)
	at akka.dispatch.Mailbox.run(Mailbox.scala:224)
	at akka.dispatch.Mailbox.exec(Mailbox.scala:234)
	at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
	at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
	at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
	at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
19-06-19 21:59:24 [mist-akka.actor.default-dispatcher-35] ERROR t.utils.akka.RestartSupervisor:159 Starting child for FunctionInfoProvider failed, maxRetry reached
java.lang.IllegalStateException: Initialization of FunctionInfoProvider failed of timeout
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor$$anonfun$receive$1.applyOrElse(FunctionInfoProviderRunner.scala:60)
	at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
	at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor.aroundReceive(FunctionInfoProviderRunner.scala:48)
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:527)
	at akka.actor.ActorCell.invoke(ActorCell.scala:496)
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257)
	at akka.dispatch.Mailbox.run(Mailbox.scala:224)
	at akka.dispatch.Mailbox.exec(Mailbox.scala:234)
	at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
	at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
	at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
	at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

After this command, I can go to the user interface at http://localhost:2004/ui/jobs/overview.

Then, I enter the following from the command line:

curl --header "Content-Type: application/json" -X POST http://localhost:2004/jobs --data '{"pyPath": "/home/daniel/Documents/GitHub/apache_livy_/home/daniel/Documents/pyfiles/spark_pi.py", "name": "foo"}'

I get the following error:

The requested resource could not be found.

My environment is the following:

  • Linux Ubuntu 18.04.01 LTS Bionic
  • Java Version 1.8.0_211-b12 SE Runtime Environment
  • Spark version 2.4.3
  • Python version 3.7.1
  • Scala version 2.11.12

What am I doing wrong?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions