Skip to content

Commit e225a12

Browse files
committed
Sync flux-commands.md to MF release 6.2.0
Follows metafacture/metafacture-core#580.
1 parent bf41982 commit e225a12

File tree

1 file changed

+27
-23
lines changed

1 file changed

+27
-23
lines changed

docs/flux/flux-commands.md

Lines changed: 27 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ parent: Flux
55
nav_order: 2
66
---
77

8-
Available flux commands (With Release 1.1.2)
8+
Available flux commands (with release 1.2.0)
99
=======================
1010

1111
add-oreaggregation
@@ -170,7 +170,8 @@ decode-string
170170

171171
decode-xml
172172
----------
173-
- description: Reads an XML file and passes the XML events to a receiver.
173+
- description: Reads an XML file and passes the XML events to a receiver. Set `totalEntitySizeLimit="0"` to allow unlimited XML entities.
174+
- options: totalentitysizelimit (String)
174175
- signature: Reader -> XmlReceiver
175176
- [example in Playground](https://metafacture.org/playground/?example=decode-xml)
176177
- java class: [org.metafacture.xml.XmlDecoder](https://github.com/metafacture/metafacture-core/blob/master/metafacture-xml/src/main/java/org/metafacture/xml/XmlDecoder.java)
@@ -250,7 +251,7 @@ encode-literals
250251
encode-marc21
251252
-------------
252253
- description: Encodes MARC21 records
253-
- options: generateidfield (boolean)
254+
- options: generateidfield (boolean), validateleader (boolean)
254255
- signature: StreamReceiver -> String
255256
- [example in Playground](https://metafacture.org/playground/?example=encode-marc21)
256257
- java class: [org.metafacture.biblio.marc21.Marc21Encoder](https://github.com/metafacture/metafacture-core/blob/master/metafacture-biblio/src/main/java/org/metafacture/biblio/marc21/Marc21Encoder.java)
@@ -272,7 +273,7 @@ encode-pica
272273

273274
encode-xml
274275
----------
275-
- description: Encodes a stream as xml
276+
- description: Encodes a stream as XML. Defaults: `rootTag="records"`, `recordTag="record"`, no attributeMarker.
276277
- options: recordtag (String), namespacefile (String), xmlheaderversion (String), writexmlheader (boolean), xmlheaderencoding (String), separateroots (boolean), roottag (String), valuetag (String), attributemarker (String), writeroottag (boolean), namespaces (String)
277278
- signature: StreamReceiver -> String
278279
- [example in Playground](https://metafacture.org/playground/?example=encode-xml)
@@ -346,8 +347,9 @@ find-fix-paths
346347

347348
fix
348349
---
350+
- description: Applies a fix transformation to the event stream, given as the path to a fix file or the fixes themselves.
349351
- options: repeatedfieldstoentities (boolean), strictness [PROCESS, RECORD, EXPRESSION], entitymembername (String), strictnesshandlesprocessexceptions (boolean)
350-
- signature: <unknown> ->
352+
- signature: StreamReceiver -> StreamReceiver
351353
- java class: org.metafacture.metafix.Metafix
352354

353355
flatten
@@ -377,7 +379,7 @@ handle-comarcxml
377379

378380
handle-generic-xml
379381
------------------
380-
- description: A generic xml reader
382+
- description: A generic XML reader. Separates XML data in distinct records with the defined record tag name (default: `recordtagname="record"`) If no matching record tag is found, the output will be empty. The handler breaks down XML elements with simple string values and optional attributes into entities with a value subfield (name configurable) and additional subfields for each attribute. Record tag and value tag names can be configured. Attributes can get an attributeMarker.
381383
- options: emitnamespace (boolean), recordtagname (String), attributemarker (String), valuetagname (String)
382384
- signature: XmlReceiver -> StreamReceiver
383385
- [example in Playground](https://metafacture.org/playground/?example=handle-generic-xml)
@@ -391,8 +393,8 @@ handle-mabxml
391393

392394
handle-marcxml
393395
--------------
394-
- description: A marc xml reader
395-
- options: namespace (String), attributemarker (String)
396+
- description: A MARC XML reader. To read marc data without namespace specification set option `namespace=""`. To ignore namespace specification set option `ignorenamespace="true".
397+
- options: namespace (String), ignorenamespace (boolean), attributemarker (String)
396398
- signature: XmlReceiver -> StreamReceiver
397399
- [example in Playground](https://metafacture.org/playground/?example=handle-marcxml)
398400
- java class: [org.metafacture.biblio.marc21.MarcXmlHandler](https://github.com/metafacture/metafacture-core/blob/master/metafacture-biblio/src/main/java/org/metafacture/biblio/marc21/MarcXmlHandler.java)
@@ -535,21 +537,21 @@ object-to-literal
535537
-----------------
536538
- description: Outputs a record containing the input object as literal
537539
- options: recordid (String), literalname (String)
538-
- signature: <unknown> -> StreamReceiver
540+
- signature: Object -> StreamReceiver
539541
- java class: [org.metafacture.mangling.ObjectToLiteral](https://github.com/metafacture/metafacture-core/blob/master/metafacture-mangling/src/main/java/org/metafacture/mangling/ObjectToLiteral.java)
540542

541543
open-file
542544
---------
543545
- description: Opens a file.
544-
- options: decompressconcatenated (boolean), encoding (String), compression [NONE, AUTO, BZIP2, GZIP, PACK200, XZ]
546+
- options: decompressconcatenated (boolean), encoding (String), compression (String)
545547
- signature: String -> Reader
546548
- [example in Playground](https://metafacture.org/playground/?example=open-file)
547549
- java class: [org.metafacture.io.FileOpener](https://github.com/metafacture/metafacture-core/blob/master/metafacture-io/src/main/java/org/metafacture/io/FileOpener.java)
548550

549551
open-http
550552
---------
551553
- description: Opens an HTTP resource. Supports setting HTTP header fields `Accept`, `Accept-Charset`, `Accept-Encoding`, `Content-Encoding` and `Content-Type`, as well as generic headers (separated by `\n`). Defaults: request `method` = `GET`, request `url` = `@-` (input data), request `body` = `@-` (input data) if request method supports body and input data not already used, `Accept` header (`accept`) = `*/*`, `Accept-Charset` header (`acceptcharset`) = `UTF-8`, `errorprefix` = `ERROR: `.
552-
- options: method [DELETE, GET, HEAD, OPTIONS, POST, PUT, TRACE], contentencoding (String), header (String), [deprecated] encoding (String), body (String), acceptcharset (String), acceptencoding (String), url (String), accept (String), errorprefix (String), contenttype (String)
554+
- options: method [DELETE, GET, HEAD, OPTIONS, POST, PUT, TRACE], contentencoding (String), header (String), [deprecated] encoding (String), body (String), acceptcharset (String), acceptencoding (String), url (String), contenttype (String), accept (String), errorprefix (String)
553555
- signature: String -> Reader
554556
- [example in Playground](https://metafacture.org/playground/?example=open-http)
555557
- java class: [org.metafacture.io.HttpOpener](https://github.com/metafacture/metafacture-core/blob/master/metafacture-io/src/main/java/org/metafacture/io/HttpOpener.java)
@@ -584,8 +586,8 @@ pass-through
584586
print
585587
-----
586588
- description: Writes objects to stdout
587-
- options: footer (String), header (String), encoding (String), compression [NONE, AUTO, BZIP2, GZIP, PACK200, XZ], separator (String)
588-
- signature: Object ->
589+
- options: footer (String), header (String), encoding (String), compression (String), separator (String)
590+
- signature: Object -> Void
589591
- [example in Playground](https://metafacture.org/playground/?example=print)
590592
- java class: [org.metafacture.io.ObjectStdoutWriter](https://github.com/metafacture/metafacture-core/blob/master/metafacture-io/src/main/java/org/metafacture/io/ObjectStdoutWriter.java)
591593

@@ -665,6 +667,13 @@ retrieve-triple-objects
665667
- signature: Triple -> Triple
666668
- java class: [org.metafacture.triples.TripleObjectRetriever](https://github.com/metafacture/metafacture-core/blob/master/metafacture-triples/src/main/java/org/metafacture/triples/TripleObjectRetriever.java)
667669

670+
sleep
671+
-----
672+
- description: Lets the process sleep for a specific amount of time between objects.
673+
- options: sleeptime (int), timeunit [NANOSECONDS, MICROSECONDS, MILLISECONDS, SECONDS, MINUTES, HOURS, DAYS]
674+
- signature: Object -> Object
675+
- java class: org.metafacture.flowcontrol.ObjectSleeper
676+
668677
sort-triples
669678
------------
670679
- description: Sorts triples. Several options can be combined, e.g. `by="object",numeric="true",order="decreasing"` will numerically sort the Object of the triples in decreasing order (given that all Objects are indeed of numeric type).
@@ -708,7 +717,7 @@ stream-to-triples
708717

709718
stream-to-xml
710719
-------------
711-
- description: Encodes a stream as xml
720+
- description: Encodes a stream as XML. Defaults: `rootTag="records"`, `recordTag="record"`, no attributeMarker.
712721
- options: recordtag (String), namespacefile (String), xmlheaderversion (String), writexmlheader (boolean), xmlheaderencoding (String), separateroots (boolean), roottag (String), valuetag (String), attributemarker (String), writeroottag (boolean), namespaces (String)
713722
- signature: StreamReceiver -> String
714723
- java class: [org.metafacture.xml.SimpleXmlEncoder](https://github.com/metafacture/metafacture-core/blob/master/metafacture-xml/src/main/java/org/metafacture/xml/SimpleXmlEncoder.java)
@@ -761,14 +770,15 @@ write
761770
-----
762771
- description: Writes objects to stdout or a file
763772
- arguments: [stdout, PATH]
764-
- options: appendiffileexists (boolean), footer (String), header (String), encoding (String), compression (String), separator (String)
773+
- options: appendiffileexists (boolean), footer (String), header (String), encoding (String), compression [NONE, AUTO, BZIP2, GZIP, PACK200, XZ], separator (String)
765774
- signature: Object -> Void
766775
- java class: [org.metafacture.io.ObjectWriter](https://github.com/metafacture/metafacture-core/blob/master/metafacture-io/src/main/java/org/metafacture/io/ObjectWriter.java)
767776

768777
write-files
769778
-----------
779+
- description: Writes objects to one (or more) file(s)
770780
- options: appendiffileexists (boolean), footer (String), header (String), encoding (String), compression [NONE, AUTO, BZIP2, GZIP, PACK200, XZ], separator (String)
771-
- signature: Object ->
781+
- signature: Object -> Void
772782
- java class: [org.metafacture.io.ObjectFileWriter](https://github.com/metafacture/metafacture-core/blob/master/metafacture-io/src/main/java/org/metafacture/io/ObjectFileWriter.java)
773783

774784
write-triple-objects
@@ -786,13 +796,7 @@ write-triples
786796

787797
write-xml-files
788798
---------------
789-
- description: Writes the xml into the filesystem. The filename is constructed from the xpath given as 'property'.
790-
Variables are
791-
- 'target' (determining the output directory)
792-
- 'property' (the element in the XML entity. Constitutes the main part of the file's name.)
793-
- 'startIndex' ( a subfolder will be extracted out of the filename. This marks the index' beginning )
794-
- 'stopIndex' ( a subfolder will be extracted out of the filename. This marks the index' end )
795-
799+
- description: Writes the XML into the filesystem. The filename is constructed from the XPATH given as 'property'. Variables are:`target` (determining the output directory), `property` (the element in the XML entity. Constitutes the main part of the file's name.), `startIndex` ( a subfolder will be extracted out of the filename. This marks the index' beginning ), `stopIndex` ( a subfolder will be extracted out of the filename. This marks the index' end )
796800
- options: endindex (int), startindex (int), property (String), filesuffix (String), encoding (String), compression (String), target (String)
797801
- signature: StreamReceiver -> Void
798802
- java class: [org.metafacture.xml.XmlFilenameWriter](https://github.com/metafacture/metafacture-core/blob/master/metafacture-xml/src/main/java/org/metafacture/xml/XmlFilenameWriter.java)

0 commit comments

Comments
 (0)