`from_json` examples runs into endless processing

[TobiasNx]

https://test.metafacture.org/playground/?flux=inputFile%0A%7Copen-file%0A%7Cas-records%0A%7Cdecode-yaml%0A%7Cfix%28transformationFile%29%0A%7Cencode-yaml%0A%7Cprint%0A%3B&transformation=from_json%28%22authorJsonValue%22%29%0Amove_field%28%22authorJsonValue%22%2C%22author%5B%5D%22%29%0A%0A%0A&data=---%0AauthorJsonValue%3A+%22%5B%7B\%22name\%22%3A\%22Test+Team\%22%2C\%22@type\%22%3A\%22Organization\%22%7D%2C%7B\%22name\%22%3A\%22\%0A++Maxi+Muster\%22%2C\%22@type\%22%3A\%22Person\%22%7D%2C%7B\%22name\%22%3A\%22Sally+Sample\%22%2C\%22@type\%22%3A\%22Person\%22\%0A++%7D%5D%22

when running it on the command line it does not create any problems.

[dr0i]

Looking at server's log:

app-1 | java.lang.NoClassDefFoundError: com/fasterxml/jackson/core/exc/StreamConstraintsException
app-1 | at com.fasterxml.jackson.databind.node.JsonNodeFactory.arrayNode(JsonNodeFactory.java:339)
[...]
app-1 | at org.metafacture.metafix.JsonValue$Parser.parse(JsonValue.java:66)

This indicates a library dependency problem with jackson.

Doing a ./gradlew :metafix:dependencies reveals i.a. jackson-core:2.11.3, jackson-core:2.13.3, jackson-core:2.14.2, jackson-core:2.15.1

Even ./gradlew :metafacture-json:dependencies shows two jackson-core version 2.14.2 -> 2.15.1.

That it's sometimes working and sometimes not is possible - I have experienced in the past that sometimes version x is precedented by version y and only schrödingers cat knows why.
But we can and should explicitly declare what library version should be used in org.metafacture.metafix.JsonValue.

[dr0i]

Whole stacktrace:

app-1 | 2025-02-11 15:07:48 [qtp26979720-834] WARN org.eclipse.jetty.server.HttpChannel - /process
app-1 | java.lang.NoClassDefFoundError: com/fasterxml/jackson/core/exc/StreamConstraintsException
app-1 | at com.fasterxml.jackson.databind.node.JsonNodeFactory.arrayNode(JsonNodeFactory.java:339)
app-1 | at com.fasterxml.jackson.databind.deser.std.JsonNodeDeserializer.deserialize(JsonNodeDeserializer.java:104)
app-1 | at com.fasterxml.jackson.databind.deser.std.JsonNodeDeserializer.deserialize(JsonNodeDeserializer.java:25)
app-1 | at com.fasterxml.jackson.databind.deser.DefaultDeserializationContext.readRootValue(DefaultDeserializationContext.java:323)
app-1 | at com.fasterxml.jackson.databind.ObjectMapper._readTreeAndClose(ObjectMapper.java:4867)
app-1 | at com.fasterxml.jackson.databind.ObjectMapper.readTree(ObjectMapper.java:3219)
app-1 | at org.metafacture.metafix.JsonValue$Parser.parse(JsonValue.java:66)
app-1 | at org.metafacture.metafix.FixMethod$38.lambda$apply$0(FixMethod.java:508)
app-1 | at org.metafacture.metafix.Value$TypeMatcher.match(Value.java:358)
app-1 | at org.metafacture.metafix.Value$TypeMatcher.ifString(Value.java:339)
app-1 | at org.metafacture.metafix.FixMethod$38.lambda$apply$1(FixMethod.java:506)
app-1 | at org.metafacture.metafix.Value.extractType(Value.java:214)
app-1 | at org.metafacture.metafix.Record.transform(Record.java:230)
app-1 | at org.metafacture.metafix.FixMethod$38.apply(FixMethod.java:505)
app-1 | at org.metafacture.metafix.RecordTransformer.lambda$processFunction$20(RecordTransformer.java:206)
app-1 | at org.metafacture.metafix.RecordTransformer.lambda$processFix$22(RecordTransformer.java:226)
app-1 | at org.metafacture.metafix.RecordTransformer.lambda$transform$1(RecordTransformer.java:125)
app-1 | at org.metafacture.metafix.RecordTransformer.tryRun(RecordTransformer.java:237)
app-1 | at org.metafacture.metafix.RecordTransformer.lambda$transform$2(RecordTransformer.java:125)
app-1 | at java.base/java.lang.Iterable.forEach(Iterable.java:75)
app-1 | at org.metafacture.metafix.RecordTransformer.transform(RecordTransformer.java:124)
app-1 | at org.metafacture.metafix.Metafix.endRecord(Metafix.java:257)
app-1 | at org.metafacture.yaml.YamlDecoder.decode(YamlDecoder.java:210)
app-1 | at org.metafacture.yaml.YamlDecoder.process(YamlDecoder.java:159)
app-1 | at org.metafacture.yaml.YamlDecoder.process(YamlDecoder.java:44)
app-1 | at org.metafacture.io.RecordReader.emitRecord(RecordReader.java:144)
app-1 | at org.metafacture.io.RecordReader.process(RecordReader.java:132)
app-1 | at org.metafacture.io.RecordReader.process(RecordReader.java:40)
app-1 | at org.metafacture.io.FileOpener.process(FileOpener.java:158)
app-1 | at org.metafacture.io.FileOpener.process(FileOpener.java:41)
app-1 | at org.metafacture.flux.parser.StringSender.process(StringSender.java:43)
app-1 | at org.metafacture.flux.parser.Flow.start(Flow.java:118)
app-1 | at org.metafacture.flux.parser.FluxProgramm.start(FluxProgramm.java:168)
app-1 | at org.metafacture.runner.Flux.main(Flux.java:87)
app-1 | at metafacture_playground.process$process.invokeStatic(process.clj:34)
app-1 | at metafacture_playground.process$process.invoke(process.clj:24)
app-1 | at metafacture_playground.handler$process_request.invokeStatic(handler.clj:29)
app-1 | at metafacture_playground.handler$process_request.invoke(handler.clj:27)
app-1 | at metafacture_playground.handler$fn__3818.invokeStatic(handler.clj:96)
app-1 | at metafacture_playground.handler$fn__3818.invoke(handler.clj:92)
app-1 | at compojure.core$wrap_response$fn__2406.invoke(core.clj:158)
app-1 | at compojure.core$wrap_route_middleware$fn__2390.invoke(core.clj:128)
app-1 | at compojure.core$wrap_route_info$fn__2395.invoke(core.clj:137)
app-1 | at compojure.core$wrap_route_matches$fn__2399.invoke(core.clj:146)
app-1 | at compojure.core$routing$fn__2414.invoke(core.clj:185)
app-1 | at clojure.core$some.invokeStatic(core.clj:2701)
app-1 | at clojure.core$some.invoke(core.clj:2692)
app-1 | at compojure.core$routing.invokeStatic(core.clj:185)
app-1 | at compojure.core$routing.doInvoke(core.clj:182)
app-1 | at clojure.lang.RestFn.applyTo(RestFn.java:139)
app-1 | at clojure.core$apply.invokeStatic(core.clj:667)
app-1 | at clojure.core$apply.invoke(core.clj:660)
app-1 | at compojure.core$routes$fn__2418.invoke(core.clj:192)
app-1 | at ring.middleware.params$wrap_params$fn__3519.invoke(params.clj:67)
app-1 | at metafacture_playground.handler$wrap_body_string$fn__3780.invoke(handler.clj:18)
app-1 | at clojure.lang.Var.invoke(Var.java:384)
app-1 | at ring.adapter.jetty$proxy_handler$fn__4037.invoke(jetty.clj:27)
app-1 | at ring.adapter.jetty.proxy$org.eclipse.jetty.server.handler.AbstractHandler$ff19274a.handle(Unknown Source)
app-1 | at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
app-1 | at org.eclipse.jetty.server.Server.handle(Server.java:501)
app-1 | at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
app-1 | at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556)
app-1 | at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
app-1 | at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
app-1 | at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
app-1 | at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
app-1 | at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
app-1 | at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336)
app-1 | at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313)
app-1 | at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)
app-1 | at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129)
app-1 | at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375)
app-1 | at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
app-1 | at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
app-1 | at java.base/java.lang.Thread.run(Thread.java:829)
app-1 | Caused by: java.lang.ClassNotFoundException: com.fasterxml.jackson.core.exc.StreamConstraintsException
app-1 | at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
app-1 | at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
app-1 | at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
app-1 | ... 75 more

[blackwinter]

No one has observed this error on the command-line (with Gradle), only in the Playground (with sbt), right? That would point to a dependency resolution issue with sbt. Not sure what could be done there.

Having said that, I would support a dependency consolidation effort to align all versions used within metafacture-core. It's quite a mess at the moment.

[dr0i]

Deployed to stage and production. Closed.