Build system discussion

Newcomer Posts : 94 Reputation : 15 Join date : 2013-03-18

Finally gave it a try!

Had a couple of unsolved problem and question along the line.

First of all, I didn't know about PowerShell and couldn't find it by searching the windows menu button. I found it in the following folder from the menu :

"Alll Program -> Accessories -> PowerShell"

It should be added to the readme.

I'm not sure about the goal of the task #3 : 3. Run the setup script.

Is it to install MinGW on the computer ? Anyway it doesn't work for me. Right-clicking and selecting Run with Powershell give me ExecutionPolicy issues and it close instantly. Had to take a screenshot to read the error. I then went in powershell, changed the ExecutionPolicy again as written and went to run the script.ps1 file from there. My PowerShell just freeze whenever I call it. It isn't buggy but I just can't do anything and it doesn't seems to be processing.Ctrl+C doesn't stop it either.

I installed MinGW myself to C:\MinGW with their installer. Everything worked fine. Added environment path variable myself.

I tried to run the Cmake config. I used a already installed 2.8 version with path added to environment.

Question, For a Windows 7 install, do I need to run :
configure_toolchain.cmake
or
toolchain_win.cmake.in

None of them succeeded even if I changed the name to toolchain.cmake.

Here is the Cmake Failing Log :

Spoiler:

I'll probably do some more tries tommorow. The readme is really clear and concise. Nice job!

Subject: Re: Build system discussion Thu Mar 28, 2013 3:29 am

RodGame wrote:: "Alll Program -> Accessories -> PowerShell"

It should be added to the readme.

Will do!

RodGame wrote:: I'm not sure about the goal of the task #3 : 3. Run the setup script.

As you already guessed, it's to install all the necessary dependencies. At the moment, those are MinGW with GCC 4.8, the Boost libraries 1.51.0 and Ogre SDK 1.8.1. The script also generates the toolchain file that tells CMake not only which compiler to use, but also where to find the dependencies. You can set all those manually, but it's a pain in the Belgium to remember and set all those paths. Anyway, I'll clarify the purpose of the script in the readme.

RodGame wrote:: My PowerShell just freeze whenever I call it. It isn't buggy but I just can't do anything and it doesn't seems to be processing.Ctrl+C doesn't stop it either.

That's strange. If it doesn't even open a dialog for directory selection, try and minimize some other windows, maybe the dialog is hiding somewhere underneath. If it freezes after selecting a directory, maybe it's downloading the dependencies, which can take a while. If that's the case, I'll have to print out a message to let the user know that at least something's happening. Unfortunately, I didn't find a way to display a progress bar or estimate the remaining time until the downloads complete.

RodGame wrote:: Question, For a Windows 7 install, do I need to run :
configure_toolchain.cmake
or
toolchain_win.cmake.in

Neither. Those are only used by the setup script to create the actual toolchain file.

Newcomer Posts : 94 Reputation : 15 Join date : 2013-03-18

Nimbal wrote:: That's strange. If it doesn't even open a dialog for directory selection, try and minimize some other windows, maybe the dialog is hiding somewhere underneath. If it freezes after selecting a directory, maybe it's downloading the dependencies, which can take a while. If that's the case, I'll have to print out a message to let the user know that at least something's happening. Unfortunately, I didn't find a way to display a progress bar or estimate the remaining time until the downloads complete.

Just did some testing and I don't think it is hiding somewhere. I alt-tabbed everything, make everything displayed then minimized everything a couple time in all way I could think of.
I don't have any dialog popping. PowerShell doesn't give me a new line starting with the current directory. There is just the cursor beeping like always and I can scroll the PowerShell. It seems like it try to open something, can't, but doesn't go to the next line in the PowerShell. It just get lost there.

Off to bed for now, I haven't said my last word to this fight yet!

Subject: Re: Build system discussion Thu Mar 28, 2013 12:25 pm

All, right, I am running a Windows Vista computer with Code::Blocks, when i first tried to set it up, it did not give me an option to choose a custom path, it was a white box, (i found out later it installed into a temp directory in the folder that the set up script was in. (for setting up the MinGW compiler))

I will report back later on when i set up code blocks for it.

Subject: Re: Build system discussion Thu Mar 28, 2013 12:48 pm

Ah, I've identified the problem, I think. The dialog for folder selection only works when I start the script from within the "Powershell ISE" (an IDE for Powershell). If I right-click on the script and select "Run with Powershell", I also only get a blinking cursor. I'll see what I can do about this.

@untrustedlife: Your username on your PC is not "ben", by chance, is it? I added some debugging stuff so I didn't have to select the directory every time I started the script to test it and forgot to take that out.

Subject: Re: Build system discussion Thu Mar 28, 2013 1:14 pm

Nimbal wrote:: Ah, I've identified the problem, I think. The dialog for folder selection only works when I start the script from within the "Powershell ISE" (an IDE for Powershell). If I right-click on the script and select "Run with Powershell", I also only get a blinking cursor. I'll see what I can do about this.

@untrustedlife: Your username on your PC is not "ben", by chance, is it? I added some debugging stuff so I didn't have to select the directory every time I started the script to test it and forgot to take that out.

No , my username is not Ben.
I tried again,and i will explain in full the problem, it is not allowing me to choose a directory, buttons come up, but they do not do anything. Hope that helps .

Newcomer Posts : 94 Reputation : 15 Join date : 2013-03-18

@UntrstedLife
Have you tried running it from the ISE as an administrator ? It worked well for me.

@Nimbal
I opened the PowerShell ISE as you mentionned.

Executed those 2 lines :
set-executionpolicy remotesigned
E:\GitHub\Thrive\mingw_setup\setup.ps1

The dialog got hidden behind the PowerShell. Might be worth a mention to prevent user from searching it.

Along the way, I had this error. Gave you a bit before and a bit after to give you an idea of where that happened.:

Spoiler:

Also had this one :

Spoiler:

and last one which is similar to first :

Spoiler:

The script took around 8-15 minutes to process. Now everything is sitting in the "temp" folder and I have the toolchain in "cmake".

So I tried to use cmake. Reisntalled it to make sure the path was added to environment and I had the suggested version.
It fail and here is the error I'm getting :

Spoiler:

I don't know what are the variable it is talking about(i.e : CMAKE_MAKE_PROGRAM).
Also, only file in my "build/CMakeFiles" folder is "cmake.check_cache"

I'm getting there!

Subject: Re: Build system discussion Thu Mar 28, 2013 1:33 pm

I'm going to try and run CMake and see what happens, the first time i tried i got many errors.So les see what happens now.

Subject: Re: Build system discussion Thu Mar 28, 2013 1:44 pm

Rod, what OS and Powershell version are you using?

Could you try the following, please, just for error analysis:

1. Open a command shell (should be under Programs -> Accessories -> Command Prompt)

2. Type in "robocopy" and hit return

What's the output? "Command not found", or some help message for the robocopy program?

Newcomer Posts : 94 Reputation : 15 Join date : 2013-03-18

I'm using a legit copy of Windows 7 Home Premium.
I'm using PowerShell Version 2.0. If anyone is looking to fin his, I used the command "Get-Host" to find it.

If I'm running the cmd.exe as Administrator, I get the help information about robocopy which mean it exist on my computer.

If I run cmd.exe without administrator right, I get :
'robocopy' is not recognized as an internal or external command, operable program or batch file.

I'll try to run Cmake again as administrator but I'm pretty sure I did.

Also, I'm on the chat if you guys want to discuss it there.

Subject: Re: Build system discussion Thu Mar 28, 2013 2:23 pm

I Have never used CMake before so
All right this is embarrassing what the heck did I do wrong /:

Note that the dialog box did not work either, it didn't give me a choice as to where to set up.So i used the stuff in the temp folder that was created.

CMake Error: CMake was unable to find a build program corresponding to "MinGW Makefiles". CMAKE_MAKE_PROGRAM is not set. You probably need to select a different build tool.
CMake Error: CMake was unable to find a build program corresponding to "MinGW Makefiles". CMAKE_MAKE_PROGRAM is not set. You probably need to select a different build tool.
CMake Error: Error required internal CMake variable not set, cmake may be not be built correctly.
Missing variable is:
CMAKE_C_COMPILER_ENV_VAR
CMake Error: Error required internal CMake variable not set, cmake may be not be built correctly.
Missing variable is:
CMAKE_C_COMPILER
CMake Error: Could not find cmake module file:C:/Users/Deb/Desktop/tbuild/CMakeFiles/2.8.10.2/CMakeCCompiler.cmake
CMake Error: Error required internal CMake variable not set, cmake may be not be built correctly.
Missing variable is:
CMAKE_CXX_COMPILER_ENV_VAR
CMake Error: Error required internal CMake variable not set, cmake may be not be built correctly.
Missing variable is:
CMAKE_CXX_COMPILER
CMake Error: Could not find cmake module file:C:/Users/Deb/Desktop/tbuild/CMakeFiles/2.8.10.2/CMakeCXXCompiler.cmake
CMake Error: CMAKE_C_COMPILER not set, after EnableLanguage
CMake Error: CMAKE_CXX_COMPILER not set, after EnableLanguage
Configuring incomplete, errors occurred!

Subject: Re: Build system discussion Thu Mar 28, 2013 2:30 pm

untrustedlife wrote:: All right this is embarrassing what the heck did I do wrong /:

It's embarassing, yes, but for me, not for you. Don't worry, if the setup script didn't run properly (which it probably didn't, if it didn't even ask you for a directory), CMake will probably act all weird and nothing will work.

I'm working on a fix for the problems so far. Stay tuned.

Newcomer Posts : 94 Reputation : 15 Join date : 2013-03-18

I just want to mention that untrustedlife and I have the exact same error report.

Setup.ps1 worked well for me appart from the robocopy issues I mentionned. Those might however be big issues, I don't know.

And be sure it is not embarassing at all, you've done tremendous work so far and it's nice to see you work the issue as fast as you can. We'll wait until you fix it, no problem.

Subject: Re: Build system discussion Thu Mar 28, 2013 5:46 pm

I think I fixed all problems that cropped up so far. Please check out the latest commit and try it out when you have time.

Newcomer Posts : 94 Reputation : 15 Join date : 2013-03-18

Setup.ps1 ran perfectly.

I know have a mingw32-d2 and OgreSDK along the original cmake,install and temp in the MinGW folder. Is that OK?
temp still contains 4 folder(7zip, boost, mingw and ogre). Install is empty.

My folder is 2.6gb and last one when it failed was 1.3gb. Can you give me and idea of the download for the process ? 1 Gb ?

Cmake didn't work. I still have the exact same error. Still missing the variables.

Subject: Re: Build system discussion Fri Mar 29, 2013 5:13 am

Oops, the setup script still had a problem where it wouldn't copy MinGW correctly. I've pushed an update. You can also just copy the content of mingw32-dw2 to its parent folder, so that you have "bin, lib, include, libexec etc." in the same folder as "OgreSDK, install, temp, etc.".

Also, you might need to delete the build directory before using CMake again. The "delete cache" option in the CMake GUI doesn't delete enough when it concerns the compiler paths.

Newcomer Posts : 94 Reputation : 15 Join date : 2013-03-18

I just moved in a new appartment so I don't have internet yet. I'm using my cellphone right now and won't be able to try the new build system before a couple of days.

You didn't answer my last question, how much are we downloading while using setup.ps1 ? Around 1gb ?

Thanks and good job as usual!

Subject: Re: Build system discussion Sat Mar 30, 2013 10:00 am

Nimbal wrote:: Oops, the setup script still had a problem where it wouldn't copy MinGW correctly. I've pushed an update. You can also just copy the content of mingw32-dw2 to its parent folder, so that you have "bin, lib, include, libexec etc." in the same folder as "OgreSDK, install, temp, etc.".

Also, you might need to delete the build directory before using CMake again. The "delete cache" option in the CMake GUI doesn't delete enough when it concerns the compiler paths.

All right, ill do it after i clean my desktop up a bit. (maybe tonight)

edit: Ill do it tomorrow at some point, however once i do have the code and edit (specifically i want to add some functions involving sound (unless they are in there already) and help to work with organelles based on the style in my prototype.) what do i do with it. Do i need a git-hub account?

Subject: Re: Build system discussion Sun Mar 31, 2013 4:13 pm

RodGame wrote:: You didn't answer my last question, how much are we downloading while using setup.ps1 ? Around 1gb ?

Oops, sorry. The script downloads about 200 MB of data, which is inflated to a whopping 2.9 GB for me (that includes the downloads themselves).

If disk space is an issue, you can safely delete the "temp" folder after installation, which will free up about 1.9 GB. I wouldn't exactly recommend it though, because when we add new dependencies, the updated setup script will have to redownload everything.

You could, however, go into each subfolder below "temp" and delete everything but the zip / 7z or exe files you find directly below them.

Subject: Re: Build system discussion Mon Apr 01, 2013 9:16 am

I keep getting distracted with things.. ill try to do it in the next 2 days, (spring break is over)
Ok, i will definetly do it by Thursday, most likely tomorrow around (18:00 GMT/UTC -6 hours)

Subject: Re: Build system discussion Mon Apr 01, 2013 9:26 am

I will try it whenever i get back home, the only computer i have avaible right now only accepts windows xp. If a few people report it is working fine tell here and i will accept the pull request.

Newcomer Posts : 94 Reputation : 15 Join date : 2013-03-18

Nimbal wrote:

RodGame wrote:: You didn't answer my last question, how much are we downloading while using setup.ps1 ? Around 1gb ?

Oops, sorry. The script downloads about 200 MB of data, which is inflated to a whopping 2.9 GB for me (that includes the downloads themselves).

If disk space is an issue, you can safely delete the "temp" folder after installation, which will free up about 1.9 GB. I wouldn't exactly recommend it though, because when we add new dependencies, the updated setup script will have to redownload everything.

You could, however, go into each subfolder below "temp" and delete everything but the zip / 7z or exe files you find directly below them.

Thank you.

It's not really a matter of disk size but a matter of bandwith. Don't know about your country, but here in Canada, we get a shitty bandwith limit. I had 15 gb at my parent place and now have 75 gb here. Downloading 3 gb is non-negligeable. 200 MB isn't really a problem but it would be nice to state it in the readme.

---------------------------- --------------------------------- -------------------------------- ---------------------

EDIT : Got around to try it today. I deleted everything that was in C:\MinGW, deleted my whole gitHub repository and recloned it.

It didn't work, here are some information.

First, here is both the cmake LOG(line 1-40) and the setup.ps1 LOG(line 40-65 000). It was too long to put it in spoiler so I uploaded it to dropBox.

https://dl.dropbox.com/u/156274557/Thrive%20Build%20-%20Setup.ps1%20LOG.txt

My MinGW has been 1gb for a really long time during installation (while installing boost i think) and is now 2.9 gb after setup.ps1 finished.

setup.ps1

I'm not quite sure how well it worked. Last time I tried it, it took around 30 min and copy didn't failed as much as it did this time(see spoiler below)
It took 2h20 to run on a Quadcore i7 laptop with 8gb of RAM for reference.

I think 1h30 was spent on boost as it seems that it was looping or something.

This pattern repeat very often and I think that some file tried to copy many times.

Spoiler:

Here is the log of the end of boost :

Spoiler:

cmake

It seems like it didnt go quite far. It found things related to OGRE but seems to lack some OIS Library.

Log :

Spoiler:

If you want me to test anything, it shouldn't take long after you post it. I'll also be ready to make a new build test whenever you commit changes.

Subject: Re: Build system discussion Wed Apr 10, 2013 2:39 pm

I just tried the script, and i get the exact same problem as RodGame, CMake complains about not being able to find OIS.

Edit: If i specify OIS to be in "C:\MinGW\OgreSDK\include\OIS" inside CMake, that step works fine.

Now it says it cannot find boost:

Spoiler:

I have boost set up from a previous instalation, but i've tried to use the version at OgreSDK/boost and said the same.

Subject: Re: Build system discussion Thu Apr 11, 2013 1:57 pm

Thanks for the log, Rod! That helps tremendously.

It seems like the boost install process doesn't work for you, for whatever reason (and that may be the same problem Daniferrito has). I can't reproduce it on my end, though. Could you check the following things, please?

How many files do you have in "C:\MinGW\temp\boost\boost_1_51_0\boost"?
How many files do you have in "C:\MinGW\install\include\boost"?
Open "Thrive\mingw_setup\boost\setup.ps1" with some text editor, go to line 73 and delete the " | out-null" at the end of this line. Start the setup process and post another log of the output. You can cancel the process when the boost archives have been unpacked (so you don't have to wait for over two hours).

Newcomer Posts : 94 Reputation : 15 Join date : 2013-03-18

Nimbal wrote:: o How many files do you have in "C:\MinGW\temp\boost\boost_1_51_0\boost"?

There are 209 items in directly in \boost. 87 of them being folders.
boost folder property says that there are 9012 Files\758 folder total in it for 85Mb/105Mb(on disk).

Nimbal wrote:: o How many files do you have in "C:\MinGW\install\include\boost"?

There are 87 items in directly in \boost, all of them being folders. I'm missing all the *.hpp found in the temp folder that you mentioned above.
boost folder property says that there are 0 Files\757 folder total in it for 0Mb/0Mb(on disk).

As you see, no file has been copied from temp to install.

Nimbal wrote:: o Open "Thrive\mingw_setup\boost\setup.ps1" with some text editor, go to line 73 and delete the " | out-null" at the end of this line. Start the setup process and post another log of the output. You can cancel the process when the boost archives have been unpacked (so you don't have to wait for over two hours).

edit :

I assume you were talking about "Thrive\mingw_setup\boost\install.ps1" since it has the "| out-null" at line 73. "E:\GitHub\Thrive\mingw_setup\setup.ps1" doesn't have this ending at line 73.

I didn't delete anything because I didn't want to delete anything you wanted to stay there.

Here is the requested log :
https://dl.dropboxusercontent.com/u/156274557/Thrive%20Build%20-%20install.ps1%20LOG_11Apr13-15h45.txt

Since I stopped it right in the process, I'm not sure if it is worth anything, but I now have 9 .hpp files in the "C:\MinGW\install\include\boost" folder where I had 0 without removing the out-null.

"C:\MinGW\temp\boost\boost_1_51_0" is the exact same.

Also, wouldn't it be possible to set the execution policy at the start of setup.ps1? You could write the old value of the execution policy in a variable and set it back to what it was at the end of setup.ps1 if possible. It might not be possible since the execution policy prevent a script from running, which is where it would be changed. Anyway, just a suggestion.

» My Evolution System Concept
» Compound system
» System Requirements
» Application System
» Aiming System