Mixing
Error on multi module project triggering dataflow pipeline: Unable to convert url...
Getting an error when trying to execute a Dataflow pipeline using spring boot war / swagger:
Caused by: java.lang.IllegalArgumentException: Unable to convert url (jar:file:/home/java/app.war!/WEB-INF/classes!/) to file.
at org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage(PipelineResources.java:55)
at org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:266)
... 78 more
Caused by: java.lang.IllegalArgumentException: URI is not hierarchical
at java.io.File.<init>(File.java:418)
at org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage(PipelineResources.java:52)
... 79 more
It seems to be failing when trying to set the Runner for dataflow and bringing the dependency to the project:
options.setRunner(DataflowRunner.class);
I have tried already to include the plugin for self-contained jars for dataflow:
<build>
<!--Self contained jar compilation for dataflow : https://beam.apache.org/documentation/runners/dataflow/-->
<plugins>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-jar-plugin</artifactId>
<version>3.1.1</version>
<configuration>
<archive>
<manifest>
<addClasspath>true</addClasspath>
<classpathPrefix>lib/</classpathPrefix>
<mainClass>MAIN-CLASS-HERE</mainClass>
</manifest>
</archive>
</configuration>
</plugin>
</plugins>
</build>
I have found a similar thread but without a clear resolution to the problem: IllegalArgumentException: Unable to convert url (jar:file:/app.jar!/BOOT-INF/classes!/) to file
spring-boot google-cloud-dataflow apache-beam
asked Jan 2 at 11:56
FERNANDO SOUZAFERNANDO SOUZA
206
add a comment |
Getting an error when trying to execute a Dataflow pipeline using spring boot war / swagger:
Caused by: java.lang.IllegalArgumentException: Unable to convert url (jar:file:/home/java/app.war!/WEB-INF/classes!/) to file.
at org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage(PipelineResources.java:55)
at org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:266)
... 78 more
Caused by: java.lang.IllegalArgumentException: URI is not hierarchical
at java.io.File.<init>(File.java:418)
at org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage(PipelineResources.java:52)
... 79 more
It seems to be failing when trying to set the Runner for dataflow and bringing the dependency to the project:
options.setRunner(DataflowRunner.class);
I have tried already to include the plugin for self-contained jars for dataflow:
<build>
<!--Self contained jar compilation for dataflow : https://beam.apache.org/documentation/runners/dataflow/-->
<plugins>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-jar-plugin</artifactId>
<version>3.1.1</version>
<configuration>
<archive>
<manifest>
<addClasspath>true</addClasspath>
<classpathPrefix>lib/</classpathPrefix>
<mainClass>MAIN-CLASS-HERE</mainClass>
</manifest>
</archive>
</configuration>
</plugin>
</plugins>
</build>
I have found a similar thread but without a clear resolution to the problem: IllegalArgumentException: Unable to convert url (jar:file:/app.jar!/BOOT-INF/classes!/) to file
spring-boot google-cloud-dataflow apache-beam
asked Jan 2 at 11:56
FERNANDO SOUZAFERNANDO SOUZA
206
Hi all, got to bypass the org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage setting the resources with options.setFilesToStage.
– FERNANDO SOUZA
Jan 2 at 15:26
1
If this is the solution to your problem, can you post it as an answer and mark it as solution? Thank you
– Anton
Jan 2 at 23:53
Hi Anton, I'll do it. Thks!
– FERNANDO SOUZA
Jan 14 at 11:49
add a comment |
Getting an error when trying to execute a Dataflow pipeline using spring boot war / swagger:
Caused by: java.lang.IllegalArgumentException: Unable to convert url (jar:file:/home/java/app.war!/WEB-INF/classes!/) to file.
at org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage(PipelineResources.java:55)
at org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:266)
... 78 more
Caused by: java.lang.IllegalArgumentException: URI is not hierarchical
at java.io.File.<init>(File.java:418)
at org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage(PipelineResources.java:52)
... 79 more
It seems to be failing when trying to set the Runner for dataflow and bringing the dependency to the project:
options.setRunner(DataflowRunner.class);
I have tried already to include the plugin for self-contained jars for dataflow:
<build>
<!--Self contained jar compilation for dataflow : https://beam.apache.org/documentation/runners/dataflow/-->
<plugins>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-jar-plugin</artifactId>
<version>3.1.1</version>
<configuration>
<archive>
<manifest>
<addClasspath>true</addClasspath>
<classpathPrefix>lib/</classpathPrefix>
<mainClass>MAIN-CLASS-HERE</mainClass>
</manifest>
</archive>
</configuration>
</plugin>
</plugins>
</build>
I have found a similar thread but without a clear resolution to the problem: IllegalArgumentException: Unable to convert url (jar:file:/app.jar!/BOOT-INF/classes!/) to file
spring-boot google-cloud-dataflow apache-beam
asked Jan 2 at 11:56
FERNANDO SOUZAFERNANDO SOUZA
206
Getting an error when trying to execute a Dataflow pipeline using spring boot war / swagger:
Caused by: java.lang.IllegalArgumentException: Unable to convert url (jar:file:/home/java/app.war!/WEB-INF/classes!/) to file.
at org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage(PipelineResources.java:55)
at org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:266)
... 78 more
Caused by: java.lang.IllegalArgumentException: URI is not hierarchical
at java.io.File.<init>(File.java:418)
at org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage(PipelineResources.java:52)
... 79 more
It seems to be failing when trying to set the Runner for dataflow and bringing the dependency to the project:
options.setRunner(DataflowRunner.class);
I have tried already to include the plugin for self-contained jars for dataflow:
<build>
<!--Self contained jar compilation for dataflow : https://beam.apache.org/documentation/runners/dataflow/-->
<plugins>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-jar-plugin</artifactId>
<version>3.1.1</version>
<configuration>
<archive>
<manifest>
<addClasspath>true</addClasspath>
<classpathPrefix>lib/</classpathPrefix>
<mainClass>MAIN-CLASS-HERE</mainClass>
</manifest>
</archive>
</configuration>
</plugin>
</plugins>
</build>
I have found a similar thread but without a clear resolution to the problem: IllegalArgumentException: Unable to convert url (jar:file:/app.jar!/BOOT-INF/classes!/) to file
spring-boot google-cloud-dataflow apache-beam
spring-boot google-cloud-dataflow apache-beam
asked Jan 2 at 11:56
FERNANDO SOUZAFERNANDO SOUZA
206
asked Jan 2 at 11:56
FERNANDO SOUZAFERNANDO SOUZA
206
edited Jan 2 at 12:35
FERNANDO SOUZA
asked Jan 2 at 11:56
FERNANDO SOUZAFERNANDO SOUZA
206
asked Jan 2 at 11:56
FERNANDO SOUZAFERNANDO SOUZA
206
asked Jan 2 at 11:56
FERNANDO SOUZAFERNANDO SOUZA
206
206
Hi all, got to bypass the org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage setting the resources with options.setFilesToStage.
– FERNANDO SOUZA
Jan 2 at 15:26
1
If this is the solution to your problem, can you post it as an answer and mark it as solution? Thank you
– Anton
Jan 2 at 23:53
Hi Anton, I'll do it. Thks!
– FERNANDO SOUZA
Jan 14 at 11:49
add a comment |
Hi all, got to bypass the org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage setting the resources with options.setFilesToStage.
– FERNANDO SOUZA
Jan 2 at 15:26
1
If this is the solution to your problem, can you post it as an answer and mark it as solution? Thank you
– Anton
Jan 2 at 23:53
Hi Anton, I'll do it. Thks!
– FERNANDO SOUZA
Jan 14 at 11:49
Hi all, got to bypass the org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage setting the resources with options.setFilesToStage.
– FERNANDO SOUZA
Jan 2 at 15:26
Hi all, got to bypass the org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage setting the resources with options.setFilesToStage.
– FERNANDO SOUZA
Jan 2 at 15:26
1
1
If this is the solution to your problem, can you post it as an answer and mark it as solution? Thank you
– Anton
Jan 2 at 23:53
If this is the solution to your problem, can you post it as an answer and mark it as solution? Thank you
– Anton
Jan 2 at 23:53
Hi Anton, I'll do it. Thks!
– FERNANDO SOUZA
Jan 14 at 11:49
Hi Anton, I'll do it. Thks!
– FERNANDO SOUZA
Jan 14 at 11:49
add a comment |
1 Answer
1
active
oldest
votes
got to bypass the org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage setting the resources with options.setFilesToStage.
answered Jan 14 at 11:51
FERNANDO SOUZAFERNANDO SOUZA
206
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54005931%2ferror-on-multi-module-project-triggering-dataflow-pipeline-unable-to-convert-ur%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
got to bypass the org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage setting the resources with options.setFilesToStage.
answered Jan 14 at 11:51
FERNANDO SOUZAFERNANDO SOUZA
206
add a comment |
got to bypass the org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage setting the resources with options.setFilesToStage.
answered Jan 14 at 11:51
FERNANDO SOUZAFERNANDO SOUZA
206
add a comment |
got to bypass the org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage setting the resources with options.setFilesToStage.
answered Jan 14 at 11:51
FERNANDO SOUZAFERNANDO SOUZA
206
got to bypass the org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage setting the resources with options.setFilesToStage.
answered Jan 14 at 11:51
FERNANDO SOUZAFERNANDO SOUZA
206
answered Jan 14 at 11:51
FERNANDO SOUZAFERNANDO SOUZA
206
answered Jan 14 at 11:51
FERNANDO SOUZAFERNANDO SOUZA
206
answered Jan 14 at 11:51
FERNANDO SOUZAFERNANDO SOUZA
206
206
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f54005931%2ferror-on-multi-module-project-triggering-dataflow-pipeline-unable-to-convert-ur%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Hi all, got to bypass the org.apache.beam.runners.core.construction.PipelineResources.detectClassPathResourcesToStage setting the resources with options.setFilesToStage.
– FERNANDO SOUZA
Jan 2 at 15:26
1
If this is the solution to your problem, can you post it as an answer and mark it as solution? Thank you
– Anton
Jan 2 at 23:53
Hi Anton, I'll do it. Thks!
– FERNANDO SOUZA
Jan 14 at 11:49