I would like to share information that my open source project, Indihiang – Web log analyzing, released on version 1.0. You can read detail of these features on my blog, http://geeks.netindonesia.net/blogs/agus/archive/2010/03/25/indihiang-1-0-release.aspx 

Indihiang Project is a IIS log analyzing tool. The tool analyzes IIS Web server in comprehensive graphs and reports.  Detail for this project, check: http://indihiang.codeplex.com Ali Özgür from İstanbul Bilgi University added a new functional to support for FTP log file analyzing. You can download this fitur on his blog, http://blog.pragmasql.com/post/Patch-Open-Source-IIS-LogAnalyzer-(Indihiang)-FTP-Support.aspx  Here are samples of screenshots

Thanks for Softpedia Labs (www.SoftPedia.com) team (special thanks to Radu Bogdan) that has certified my open source project, Indihiang tool. Information about Indihiang tool on Softpedia can be found on http://www.softpedia.com/get/Internet/Servers/Server-Tools/Indihiang.shtml  Detail Note: http://www.softpedia.com/progClean/Indihiang-Clean-132815.html Indihiang 0.1 Alpha - SOFTPEDIA "100% FREE" AWARD This product was last tested in the Softpedia Labs on 6th of July 2009 by Radu Bogdan Softpedia guarantees that Indihiang 0.1 Alpha is 100% Free, which means it does not contain any form of malware, including but not limited to: spyware, viruses, trojans and backdoors. This software product was tested thoroughly and was found absolutely clean; therefore, it can be installed with no concern by any computer user. However, it should be noted that this product will be retested periodically and the award may be withdrawn, so you should check back occasionally and pay attention to the date of testing shown above.

Thanks for using Indihiang to analyze IIS log files or remote IIS. I try to improve Indihiang application such as features, performance, usability, etc. Today I uploaded updated Indihiang application version 0.2.1. What’s the improvement in Indihiang 0.2.1? As you know, Indihiang 0.2 used parallel computing feature to analyze log IIS simultaneously. I improved parallel algorithm in Indihiang. Here are the improved codes: 1: try 2: { 3: var resultData = new Future<List<BaseLogAnalyzeFeature>>[listFiles.Count]; 4: _mainTask = Task.Create( 5: delegate 6: { 7: Parallel.For(0, listFiles.Count, index => 8: { 9: List<BaseLogAnalyzeFeature> features = IndihiangHelper.GenerateParallelFeatures(LogFileFormat); 10: resultData[index] = Future.Create( 11: () => ParseLogFile(features, listFiles[index]) 12: ); 13: resultData[index].Wait(-1); 14: }); 15:  16: }, 17: _taskManager.Value, 18: TaskCreationOptions.None 19: ); 20:  21: _mainTask.Wait(-1); 22: for (int i = 0; i < resultData.Length; i++) 23: { 24: List<BaseLogAnalyzeFeature> items = resultData[i].Value; 25: items.ForEach(delegate(BaseLogAnalyzeFeature item) 26: { 27: for (int j = 0; j < _paralleFeatures.Count; j++) 28: if (_paralleFeatures[j].FeatureName == item.FeatureName) 29: _paralleFeatures[j].SynchData(item.Items); 30: }); 31:  32: items.Clear(); 33: resultData[i].Dispose(); 34: } 35: Thread.Sleep(100); 36:  37: }   _mainTask object hold a task all analyzing computation. In this task, I created parallel task using Future<T> object to handle analyzing for a log file. I also passed TaskManager object in _mainTask object to optimize processor usage. I also implemented Lazy initialization for TaskManager object, here is the illustration code as below: 1: _taskManager = new LazyInit<TaskManager>(() => new TaskManager( 2: new TaskManagerPolicy(1, Environment.ProcessorCount)), 3: LazyInitMode.AllowMultipleExecution); After all tasks created by Future<T> object, I tried to wait and make sure all tasks completed. After completed, Indihiang consolidated all log IIS files and rendered data on GUI.   What’s the Next? Now, you download Indihiang 0.2.1 for x86 and x64 platforms. You also can download the latest source code on http://indihiang.codeplex.com/Release/ProjectReleases.aspx?ReleaseId=29480  If you have any feedback please report on Indihiang portal http://www.codeplex.com/indihiang

When you use Indihiang 0.2 to analyze IIS log via IIS Remote on IIS7 on Windows Server 2008, sometimes you get error although you have filled administrator level. This problem occurs because Indihiang 0.2 uses WMI to get all log files on remote IIS so IIS7 should be configured for WMI compatibility using adding features on Server Management as below

Finally I can deliver Indihiang 0.2 today. You can download Indihiang 0.2 on CodePlex portal http://www.codeplex.com/indihiang There are many new features and enhancement from previous version. What’s new? New features are Hits analyzing for month Bandwidth analyzing Processing Request IIS log files consolidation IIS log files analyzing for Remote IIS Parallel processing using Microsoft Parallel Extensions to the .NET Framework 3.5 June 2008 I also improve the previous version. There are some enhancement features on Indihiang 0.2. General analyzing Hits analyzing enhancement Processing monitoring GUI and its functionalities enhancement I try to write the detail of these. Please keep on my blog.

To increase scalability Indihiang 0.2 provides features to enable web log analyzing with multi processes. Each process can do parallel tasks. Technical Design Once you open file, multi files, or remote IIS Indihiang 0.2 will create an Indihiang Log Parser for you. This means one analyzing process has one an Indihiang Log Parser so if an Indihiang Log Parser get problems (it may corrupt log files) then this will not impact for another Indihiang Log Parser. Each Indihiang Log Parser will create parallel tasks if there are multi log files to be analyzed. I use Microsoft Parallel Extensions to .NET Framework 3.5 technology to implement parallel computing. Due to implementing parallel tasks so you will not get sequential process on status Multiple Process with Parallel Tasks Indihiang 0.2 enables you to open log file again without waiting finishing previous process. This means Indihiang 0.2 can work multiple process. Each process will do parallel tasks to analyze Analyzing Indicators Indihiang 0.2 provides indicators you can monitoring the process is working or not. There are two Indicators. The first indicator is a progress bar as below The second indicator is status. Every activity will log on this status window.

Today I just finished Indihiang 0.2 for log file consolidation for local file and IIS remote. Indihiang 0.2 will help you to analyze IIS log file wherever log file located. Multiple Log File Consolidation Consider you got IIS log files from another machine and then you want to analyze what’s happening on these log. Just run Indihiang 0.2 and open log file with selecting all these log files. After selected log files, a consolidation form dialog will show and entry consolidation name Indihiang 0.2 will analyze the selected log files and then show the result of analyzing in graphical. Analyzing Web Log for Remote IIS Indihiang 0.2 enables your job to analyze web log easily although web log file inside on remote machine. With remote IIS in Indihiang 0.2 you just open a remote IIS dialog After clicked Connect button, you will get the list of website on remote IIS. Choose website on remote IIS you want to analyze.

Finally I finished the IIS log file consolidation for Indihiang tool two weeks ago. With this feature, you can analyze multiple IIS log files. I have tested with 276 IIS log files (thanks for Erudeye Enterprise team for providing test data). It spent less than 20 seconds on Intel Core Duo 1.8 GHz on Windows Vista 32-bit. Remember it still used the sequential processing!!. It’s fast because I changed data structure to store IIS log file object on the previous Indihiang version. I utilize generic dictionary collection with custom binary tree data structure. Currently I’m implementing Indihiang tool using parallel processing approach using Microsoft Parallel Extensions to .NET Framework 3.5 so I must change processing algorithms. I would like to utilize fully all processor cores to compute IIS log analyzing. Here are figures of the sample of Indihiang tool analyzing result.   You will get this feature on Indihiang tool on the next release, Indihiang 0.2. I’ll announce when Indihiang 0.2 will be released.

Since first released on 15 April 2009, total download of Indihiang tool is 559 (today) [V]. I would like to thank to all you for supports. I also got feedbacks via email about requested features.  Please contact me if you any idea or new feature for this project. Today I would like to share the Indihiang roadmap for the next version , Indihiang 0.2. Here is the highlight feature for Indihiang 0.2 IIS Log File Consolidation Fortunately, IIS log file consolidation can be released on Indihiang 0.2. I know one of you sent emails about multiple IIS log files analyzing. Yeah, on the original roadmap this feature should be release on Indihiang 0.1 but I postponed so I confirm this feature will be released on the next version of Indihiang tool (version 0.2). Bandwidth Analyzing I got feedbacks from Indihiang users that want to analyze bandwidth usage on web server based on IIS log file. On the next release, I put this feature to be released on version 0.2. With the feature you can see bandwidth usage such as bandwidth In/Out. This tool also analyze the bandwidth usage relate to IP Address client so we can know how many bandwidth IP Address client utilize on web server. Updated Hits Analyzing by Month and Year On current released version, you can only see the Hits analyzing by day so the next version Indihiang tool will implement Hits analyzing by day, month and year. Parallel Processing To improve the performance of Indihiang tool I’ll implement parallel processing approach. This means Indihiang tool will utilize all processor cores to compute analyzing. Parallel processing technology that I’ll implemet on Indihiang tool is Microsoft Parallel Extensions to .NET Framework 3.5. Any Feedback? If you have idea(s) to improve Indihiang tool and to enrich Indihiang tool features, please let me know..