topic Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process in Continuous Integration

General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Ryan_S — Thu, 10 Sep 2015 17:02:14 GMT

This thread can be for general thoughts/questions about the batch file build process I discuss in my presentation here and the getting started guide here.

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Ryan_S — Thu, 17 Sep 2015 14:52:28 GMT

Hey thilprakash,

The error you're seeing here is because it's expecting an "http://...." address to your SVN repo. If you'd like Jenkins to pull from a local directory on your computer, the easier way to do it (in my experience at least, there could be a better way) would be as follows:

1. Set the SCM to None instead of SVN.

2. Set your workspace path (via Manage Jenkins >> Configure System, then under "Home Directory" click advanced and change the workspace root directory) to be "E:\SENTHIL\Projects\${ITEM_FULL_NAME}" (Where item full name is a query within jenkins, not something you fill in, i.e. you'd copy over that path directly into the jenkins workspace path).

3. Make sure your Jenkins project name is "Test Auto Build" to match the name of the folder you're pointing to at "E:\SENTHIL\Projects\Test Auto Build" (since it'll append the project name based on the "Item_Full_Name query string we used above).

Then when you build the project it'll look in that local folder for the files to be built.

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Oli_Wachno — Fri, 02 Oct 2015 13:53:54 GMT

Hi Ryan,

thanks a lot for the efforts in the presentation & the getting started.

I tried to run builds as described, but I have some trouble:

SCM checkouts work perfectly, but I receive frequent error in the LabVIEWbuild.bat

Every other try, LabVIEW does not launch (I removed the -unattended option for debugging). If it launches, it'll abort almost immediately.

It's a bit unreliable on my machine.

Do you have any ideas? So far, I'm using only Version 2013

Cheers

Oli

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Ryan_S — Tue, 06 Oct 2015 18:24:05 GMT

Hey Oli,

First, glad you found the presentation and guide useful, that's great to hear

As for the issue you're hitting, I haven't seen that before. But, it's possible there's something I'm setting that I forgot to put in the guide. To investigate further, a couple questions:

1. Can you attach the output of the Jenkins console for a successful and failed build?

2. Whenever the build.bat process (or its sub-processes) encounter an error they should get logged to a file in the c:\autobuild directory. Likely named something like: "CI_0_Error2013.txt" if it's running on executor 0 for your 2013 version.

3. Since you're only running for 2013, do you see any difference in behavior if you command the batch file to only build in 2013 instead of letting it auto-determine the version? You would change your call in Jenkins to be something along the lines of "C:\Autobuild\build.bat 2013" (remember, the batch file is parameterized and specific build version is the first input). This might narrow down if there's a version decision problem occuring, in which case can you also attach your version of build.bat? (I assume you've changed it for your versions of LabVIEW).

4. Are you running more than one build at a time? If so, we're probable encountering an instancing problem. Try adding the ini token "allowmultipleinstances=True" to the LabVIEW.ini file in your "<Program Files>\National Instruments\LabVIEW 2013" directory. I recently realized I left that out of the getting started guide and you'll need it if you want to run multiple builds (see here for more info).

This should give me a better glimpse into what's happening. --Ryan

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Oli_Wachno — Wed, 07 Oct 2015 09:28:41 GMT

Hi Ryan,

thanks for the suggestions

I think, my problem is even more basic: I have scrapped my modified LabVIEWBuld.bat and switched back to the original from github.

IMHO, LabVIEW does not start up at all! The console shows shows the execution of the START command (no error) and the waiting loop keeps running. But no LabVIEW process can be seen in the task manager with or without the unattended option.

Please find the screenshots attached.The error file you've mentioned is empty.

Using LabVIEW version on Autobuild.Bat call makes no difference.

So far I haven't tried any parallel builds, since I wanted to take steps one by one.

Addtional information: I copied the parameterized START command from Jenkins' command line display to paste and execute directly from command line: it runs out, LabVIEW starts!

Is there possibly an access permission issue with the start command of the batch?

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Oli_Wachno — Wed, 07 Oct 2015 14:17:24 GMT

After some more research .... it's getting weirder

if I start the Build.bat from the command line, LabVIEW starts up with the correct VIs.

This kinda confirmed the access rights issue to me, so I started to check the Jenkins Service settings.

I enabled an option called "Enable data transfer between service & desktop" (direct translation from German). When I tried again, a dialog window appeared stating, that the service has issued a notification. It turns out, that LabVIEW is showing the License Server dialogue stating my local license has run out. That's probably the reason why LabVIEW seems not to be starting.

But I'm running on a license from our volume license server.

IMHO, Jenkins is running in a different user context that doesn't allow the usage of my volume license...

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Ryan_S — Wed, 07 Oct 2015 16:44:40 GMT

Hey Oli,

Kudos on the investigation, the console does seem to confirm that LabVIEW is being launched but is never fully initializing; which would make sense if the licensing pop-up is stopping LabVIEW from fully launching. A couple thoughts:

1. When you saw the pop-up, was there an option to continue? I.E. did it default to some temp license or not let you launch LabVIEW at all? If it's defaulting to a temp license I think I remember there being a command line command we could add to build.bat to automatically accept that.

2. A disconnected license file might be an option, although that would be up to you and your VLA admin.

3. If you simplify this to having a batch file that just launches LabVIEW, does that run successfully in Jenkins? Maybe there's something else in the current build.bat that's affecting the launch.

Overall, since this appears to have to do with LabVIEW properly getting a license when launched from the Jenkins context I would recommend contacting your local support and talking to the licensing team.

See if they have ideas about how to make sure a valid license is obtained. Maybe there's something we can edit from the command line calls (the simple test, #3, would be good to try stuff with), or maybe we need to assign the jenkins process to a certain user. It's been a while since I've dealt with licensing servers so I'm just spitballing. But they should be able to give you some ideas on ways to make sure Jenkins is able to launch LabVIEW from a batch call.

Keep me updated and I'll try to help where possible. --Ryan

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Oli_Wachno — Thu, 08 Oct 2015 08:22:47 GMT

Hey Ryan,

to answer yout questions

1.) There is a possiblity to continue if evaluation time is left. Which is not on my PC 😉 In fact, it didn't let me launch LV

2.) I've tried the disconnected license this morning: it also does not seem to work also. I suspect that there is a difference between the user name on the license server (or in the disconncted file) and the one I can assign the Jenkins service to:

WHOAMI on the commandline gives me

myorg\john.doe

whereas the user name for the service must be

john.doe@local.myorg.com

So maybe a computer based license could solve the issue. But there is none available at my company.

3.) Have tried this also: LabVIEW doesn't start, even if the batch only calls the .exe without parameters

I have started a request in the Volume License Forum, if there is a possibility to start LabVIEW with a parameter specifing a user. In parallel, I'll try what our local support here can do

Cheers

Oli

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Ryan_S — Thu, 08 Oct 2015 16:01:32 GMT

Hey Oli,

Sounds like you've identified the problem, hopefully support can give you some ideas on getting the license to be accepted. You might also search around the jenkins forums to see if there's a way to assign the jenkins process to the user account you need.

--Ryan

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Oli_Wachno — Fri, 09 Oct 2015 14:54:12 GMT

Hi Ryan,

after talking to my IT guys, Jenkins and LabVIEW are up and running

What I had to learn is that there is (at least officially) no way to start LabVIEW with a given user name. It always uses the windows user to contact the license sever.

Thanks a lot for your help

Oli

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Ryan_S — Fri, 09 Oct 2015 16:38:31 GMT

Hey Oli,

That's great to hear! I'm glad everything is working; let me know if you have any feedback on the batch file system itself or the getting started doc. Again, glad you found this approach with Jenkins useful.

Thanks! --Ryan

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Oli_Wachno — Wed, 11 Nov 2015 15:52:59 GMT

Hi everybody,

I keep putting more and more build jobs for ppls into Jenkins. An issue I have seen is that builds with dependencies seem to be a problem:

Let's say libraries B & C are depending on library A. I have configured the build jobs for B&C to be triggered on sucessfull build of library A. Jenkins starts both builds in parallel, but only one succeeds, the other on will be hund after some time.

Has anybody else seen this behaviour?

Cheers

Oli

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Ryan_S — Wed, 11 Nov 2015 23:08:36 GMT

Hmm, well you can definitely have problems if you're using shared resources (i.e. if you tried to run 2 VI package build jobs they would clash and 1 or both would hang since VIPM is a shared resource) but I guess it depends on how you're calling the library. Are you having jobs B & C reference the same built copy of A? Usuaully you would have B & C pull a copy of A into their individual workspaces for their build and I can't see that causing problems since even though it's the same named library they'd be in different instances of LabVIEW.

Thoughts?

--Ryan_S

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Oli_Wachno — Thu, 12 Nov 2015 07:08:03 GMT

Dependencies are ok, at the moment I even have lib A directly placed in the respective source directory of Libs B & C. (will be an external definition in SVN as soon as I have defined, where the respective libs will be placed within the repo)

But yes, I guess there is some issue about shared ressources. If a build gets hung on the console output you can see, that the build.vi is never called (autobuild.csv not read) since the console output is completely missing.

Just wanted to verify and found out, that this time, two builds would run in parallel (manually started), the third one was started a moment later and got stuck. I suppose there is some issue with the files used for synchronization of Jenkins & the LabVIEW build process.

At the moment I can live with this, it's a known issue and there is a (at least for the moment) feasible workaround.

Thanks for your ongoing support!

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Oli_Wachno — Thu, 12 Nov 2015 07:14:43 GMT

Just another hint for all users

I have stumbled across the issue, that consecutive builds would fail reporting

Error 74: Invalid data structure ....

This turns out to be an issue of of the SCC checkout strategy for the particular job: it disappeared when I set it to Always check out a fresh copy

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Oli_Wachno — Mon, 25 Jan 2016 16:02:53 GMT

Me again

I eventually made it to configure a build using more than one LabVIEW Version.

My current active version is 2013, I added 2014.

Things which made me stumble:

Building only in 2014 failed (no response from LabVIEW on the console output) due to missing OpenG VIs in 2014
Possible Solution: Try to open (not save!) Build.vi with every version you want to use and check for errors
Consecutive builds can cause license trouble if you're running on a VLA license: LV2013 does not shut down, before 2014 launches and tries to check out a license.
Possible Solution: Configure LabVIEW to ignore these errors and NOT show a dialog box (which causes LV to "hang" when running in the background). Telling from the task manager, LabVIEW 2013 seems to not shut down before both builds are finished

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Ryan_S — Mon, 25 Jan 2016 16:11:46 GMT

Hey Oli,

Thanks for posting these back to the community!

I've never tried to run jenkins on a VLA; kudos for troubleshooting and working around those errors!

--Ryan_S

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Oli_Wachno — Fri, 04 Mar 2016 15:18:09 GMT

Coming up with a new issue today:

Lately, I have started organizing my build jobs on Jenkins using folders to clean up a bit. This went along with Build.vi throwing funny errors of not having found some paths. This error occured always after the execution of the last build item.

Diggin a bit deeper, I found out, that Build.vi creates (temporary) folders in C:\Builds which seems to cause troubles.

So I moved my Build Job back to Jenkins root.... et voilá everything is working again

In case somebody else stumbles across sth like this

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Ryan_S — Fri, 04 Mar 2016 15:42:27 GMT

Hey Oli,

Yes, build.vi copies all of the completed built files to c:\builds at the end of the build process. We use this in our process so that we can network share that folder and others can access the latest builds.

If you don't need this functionality, you can diagram disable (or delete) the copy code in build.vi. It won't affect any of the core building features.

--Ryan_S

Re: General Discussion/Questions about LabVIEW/Jenkins with the Batch File Build Process

Ajay_MV — Wed, 11 May 2016 13:27:28 GMT

Guys... Good day to you all..! Kudos to Ryan_S for this effort... I gave a sample try with my LabVIEW 2014 and I'm stopped with some issues.

I am able to run build.bat with arguments to trigger the build from cmd prompt, however when I build with Jenkins I'm getting the PING error (quoted below)... I am sure my environment variables are set properly and so the build.bat executes without issue when I run it independently.
I found that build.bat file needs some 5 arguments which is not explained in the document. I gave these arguments (highlighted in below quoted text) explicitly in Jenkin configuration. Is this correct way? If not, from where these arguments comes to batch file?does the Jenkin will pass these arguments?
I found that indexing of the command line arguments is started at "1" in "Build.vi". Only after chaning that to "0" and other indices, my direct execution of build.bat worked in cmd prompt. Is that indexing from "1" is intentional?

Started by user anonymous
Building in workspace C:\Program Files (x86)\Jenkins\workspace\Sample Project Build
Updating https://svn.tessolve.com/svn/LabAutomation/Workspaces/Ajay Workspace/JenkingTest at revision '2016-05-11T16:01:47.614 +0530'
AU        Sample Proj.lvlps
AU        Sample Proj.aliases
AU        Autobuild.csv
U         Sample Proj.lvproj
At revision 1723
[Sample Project Build] $ cmd /c call C:\Windows\TEMP\hudson4211982921074233364.bat
C:\Program Files (x86)\Jenkins\workspace\Sample Project Build>C:\Autobuild\Jenkins-Autobuild\build.bat 2014 "D:\Workspace (Ajay SVN)\JenkingTest" f "" 0
Skipping version check on request
Running specific version build: LabVIEW 2014
Starting 2014 build...
'PING' is not recognized as an internal or external command,
operable program or batch file.
'PING' is not recognized as an internal or external command,
operable program or batch file.
'PING' is not recognized as an internal or external command,
operable program or batch file.
'PING' is not recognized as an internal or external command,
...

Thanks,

Ajay.