Expression for parsing a tab separated text/flat file, using Logic Apps




In an earlier post (https://www.blogger.com/blog/post/edit/2520883737187850604/6852187532033424242), we talked about parsing a CSV/Excel file to feed data into D365F&O, this post is a kinda corollary to that, here we'll be talking about parsing 'a tab separated' document, the necessary expression for the same.

Suppose we have a file content like this:

SalesPool Id Company Name

Poo01122 USPM Pool 11222

Poo01123 USPM Pool 11223

Poo01124 USPM Pool 11224

Poo01125 USPM Pool 11225

Poo01126 USPM Pool 11226

As you've rightly guessed, its a tab separated file. In the control connecter where you are getting the content of the file >> you can use the following expression could help you to transform the incoming content into an array:

split(decodeUriComponent(replace(replace(replace(uriComponent(body('Get_file_content_using_path')), '%0D', ''), '%09', ';'),'%0A', '#NEWLINE#')), '#NEWLINE#')

Outcome:


[

  "SalesPool Id;Company;Name",

  "Poo01122;DAT;Pool 11222",

  "Poo01123;DAT;Pool 11223",

  "Poo01124;USPM;Pool 11224",

  "Poo01125;USPM;Pool 11225",

  "Poo01126;USPM;Pool 11226"

]

Use a variable called: FileArray for the array thus generated.

Explanation

a. The expression changes the incoming string of the file content as a URIComponent, by calling the method: uriComponent().

b. It transforms all the special characters/escape sequence/delimiters, from which we are replacing the 'Carriage return' , identified as '%0D' , with ''.

c. It replaces the new line, identified as '%0A' with #NEWLINE#.    

d. It also replaces the tabs, identified as '%09' with ''.

e. And then it splits all the rows, on basis of the identifier: #NEWLINE# as separate array elements.

To understand which special character is identified as what, you can paste your text/file content manually at:

https://www.onlinewebtoolkit.com/url-encode-decode

This can help you which symbol could be encoded as what.

The rest of the process is just like the previous blog: you can query the resultant outcome, by performing a 'select' operation:

skip(variables('FileArray'),1)

Where, optionally you can skip the first row, if its a heading. And then you can map by the following key-value pair mapping:




Here as the figure indicates, the columns are evaluated by using:
split(Item(),';')?[1]

Where, 0, 1,2 , etc. indicate the sequences of the columns.

 


Comments

Post a Comment

Popular posts from this blog

Make your menu items visible on main menu, conditionally,, using this cool feature of D365FO

Image
  Wassup guys? I am sure you must have encountered this situation where you needed to display your menuItems, on main menu, based on some condition, haven't you? This was only possible by using config keys and flights. Things get a bit tricky,  when suppose you have a requirement like this: you need to make it dynamic, by introducing a toggle switch on a field on a paremeter form.  Suppose on Accounts Receivables Parameters >> You have a field called ' Show US customer '. You have a requirement that says when you turn on this toggle, then only the menuItem ' Input SSN details ', under AR module. This is now highly acheivable by leveraging subscription to 'SysMenuNavigationObjectFactory' class, simply by saying a. Create a new class USMenuItemsVisibilityManager b. Copy the following method, with proper documentation (don't change signature/anything else) [SubscribesTo(classstr(SysMenuNavigationObjectFactory), staticdelegatestr(SysMenuNavigationObjec...
Read more

Are you still using macros? Be sure you read this.

Image
  You still use a lot of macros in your code, don't you? Of course you should: Macros, as per Microsoft,  are p recompiler directives are processed before the code is compiled. The directives declare and handle macros and their values. The directives are removed by the precompiler so that the X++ compiler never encounters them. The X++ compiler only sees the sequence of characters written into the X++ code by the directives. However macros, are not quite recomended by Microsoft. They are slow, they can be subsequently deorectaed at any later time.  The Macros are  actually  a type of classes, only that they are not instantiated and not need be defined as classes. Hence runtime garbage collection could be a huge issue, consquently (a class when gets out of scope, gets garbage-collected owing to the destructor classes of DOT net instrumentation classes). Summing up, macrros are a bit old way of writing code. Use static classes instead. public static class MyIdenti...
Read more

Modifying a DMF data entity query dynamically, from another query, for filteration in D365FO

Image
  Problem statement  Have you ever came across a situation where you needed to run your data entity through a batch, and in your batch you have a very complex composite query (where the query ranges could be anything -- the user can keep adding new ranges to the query) and you need pass on the query range values to your data entity query. I bet you must have faced this: say, your data contract is having an AOT query called PurchContractQry where you have PurchTable, Purchline, InventDim, PurchParmLine and a litter of related tables. You have an entity that does have a different query (as you know Data entities store queries as packed data in DMFDefinitionGroupEntity )-- how could you possibly make the ranges flow to your Entity, then? The following blog explains the same. As an example: we have created a Data entity called D365DataEntityPurchExport , which exports records based on the ranges supplied in a query coming from a contract Class, called PurchContractQry. We need to ...
Read more