Large Xml, Sharepoint Export file Manifest.xml

Today I’m dealing with task to copy Sharepoint Web and SubWebs to the same server with selective data where SubWebs contains no ListItems.

After exporting a Web and Subwebs with option FileCompression = false, it created a 282MB large Manifest.xml.

I have tried to open it using Notepad++ It was so slow that I had to kill process to continue work, next opened with VS2010 that was much better, but to manually remove lines would take ages.

So I googled for another solution and found few programs that could manage large xml. 010Editor, XMLSpy, didn’t try any of them.

After 2 hours of searching for solution I wrote program in .NET that did it very well and took only 4 minutes to complete.

public static void StreamCustomerItem(string uri)

{

  using (XmlReader reader = XmlReader.Create(uri))

  {

    XmlWriterSettings xws = new XmlWriterSettings();

    xws.OmitXmlDeclaration = true;

    xws.Indent = true;

    xws.CheckCharacters = false;

    using (XmlWriter xw = XmlWriter.Create("Manifest.xml", xws))

    {

      XElement name = null;

      while (reader.Read())

      {

        switch (reader.NodeType)

        {

          case XmlNodeType.Element:

            if (reader.Name == "SPObject")

            {

              name = XElement.ReadFrom(reader) as XElement;

              if (name.Attribute(XName.Get("ObjectType")).Value == "SPListItem")

              {

                //Excluding unwanted content
                if (name.Attribute(XName.Get("ParentWebUrl")).Value.StartsWith("/SubwebUrl/")) continue;

              }

              name.WriteTo(xw);

              break;

            }

            xw.WriteStartElement(reader.Prefix, reader.LocalName, reader.NamespaceURI);

            xw.WriteAttributes(reader, true);

            if (reader.IsEmptyElement)

            {

              xw.WriteEndElement();

            }

            break;

          case XmlNodeType.Text:

            xw.WriteString(reader.Value);

            break;

          case XmlNodeType.Whitespace:

          case XmlNodeType.SignificantWhitespace:

            xw.WriteWhitespace(reader.Value);

            break;

          case XmlNodeType.CDATA:

            xw.WriteCData(reader.Value);

            break;

          case XmlNodeType.EntityReference:

            xw.WriteEntityRef(reader.Name);

            break;

          case XmlNodeType.XmlDeclaration:

          case XmlNodeType.ProcessingInstruction:

            xw.WriteProcessingInstruction(reader.Name, reader.Value);

            break;

          case XmlNodeType.DocumentType:

            xw.WriteDocType(reader.Name, reader.GetAttribute("PUBLIC"), reader.GetAttribute("SYSTEM"), reader.Value);

            break;

          case XmlNodeType.Comment:

            xw.WriteComment(reader.Value);

            break;

          case XmlNodeType.EndElement:

            xw.WriteFullEndElement();

            break;

        }

      }

    }

  }

}

Thanks to:
MSDN
MSDN Mark Fussell's WebLog

Exporting SharePoint web and Importing to same SiteCollection

There is built in feature in stsadm to Export and Import sites and webs, It is very useful and almost always sufficient, but there can be more complex scenarios when it is just not enough then there is way to do this in code.

private static string Export(string siteURL, string fileToExport)

{

  SPExportSettings exportSettings = new SPExportSettings();

  exportSettings.AutoGenerateDataFileName = true;

  exportSettings.ExportMethod = SPExportMethodType.ExportAll;

  exportSettings.SiteUrl = siteURL;

  exportSettings.IncludeSecurity = SPIncludeSecurity.None;

  exportSettings.IncludeVersions = SPIncludeVersions.CurrentVersion;

  exportSettings.CommandLineVerbose = true;

  exportSettings.FileLocation = fileToExport;

  SPExportObject exportObject = new SPExportObject();

  exportObject.ExcludeChildren = false;

  exportObject.Type = SPDeploymentObjectType.Web;

  using (SPSite site = new SPSite(siteURL))

  {

    using (SPWeb web = site.OpenWeb(siteURL.Substring(site.Url.Length, siteURL.Length - site.Url.Length)))

    {

      exportObject.Id = web.ID;

    }

  }

  exportObject.IncludeDescendants = SPIncludeDescendants.All;

  exportSettings.ExportObjects.Add(exportObject);

  SPExport export = new SPExport(exportSettings);

  export.Run();

  return exportSettings.FileLocation + "\\" + exportSettings.BaseFileName;

}

private static void Import(string siteURL, string fileToImport)

{

  SPImportSettings importSettings = new SPImportSettings();

  importSettings.BaseFileName = System.IO.Path.GetFileName(fileToImport);

  importSettings.FileLocation = System.IO.Path.GetDirectoryName(fileToImport);

  importSettings.SiteUrl = siteURL;

  importSettings.RetainObjectIdentity = false;

  importSettings.IncludeSecurity = SPIncludeSecurity.None;

  importSettings.UpdateVersions = SPUpdateVersions.Ignore;

  importSettings.UserInfoDateTime = SPImportUserInfoDateTimeOption.None;

  importSettings.SuppressAfterEvents = true;

  importSettings.CommandLineVerbose = true;

  SPImport import = new SPImport(importSettings);

  import.Run();

}

Continiunes (Part 2) 

SharePoint 2007 / WSS 3.0 Task Alert Issue

There is lots of blogs already about this, but I have a little different scenario.

First I have exported site using stsadm –o export and then imported it to the same server as subsite. The site contained a list called UserTasks it have a contentType that inherits from Tasks.

The issue is that user does not get email alerts when a task has been assigned to. The original site still can send email notifications.

Sharepoint have a 4 tables in database related to this:
ImmedSubscriptions  (Stores the alerts for emails that are sent immediately when changes occur)
SchedSubscriptions (Stores daily or weekly scheduled alerts)
EventLog (This table contains events for which only non-immediate alerts exist)
EventCache (This table contains a list of site events for which users have requested alerts. WSS inserts events into this table as they occur)

Scenario how I have resolved this is following.

First thing I checked ImmedSubscriptions table and found that a record related to this list is not created by import procedure. Created this record manually by copying from original site and changed fields accordingly.

stsadm -o updatealerttemplates -url <SubsiteUrl> -f "c:\Program Files\Common Files\Microsoft Shared\web server extensions\12\TEMPLATE\xml\alerttemplates.xml" -LCID 1062

stsadm -o setproperty -pn job-immediate-alerts -pv "every 1 minutes" -url <SubsiteUrl>

restarted “Windows SharePoint Services Timer” service

And it worked! :)

 

Thanks to:
Mel Lota’s weblog
Daniel Pavelescu's Blog
sharepointalert.info

WSS 3.0 / Sharepoint Performance testing

 

“Why it is so slow ?”, “What is happening ?”, “Is it still working ?”

Visual Studio 2010 Premium have built in Performance testing tool “Profiler”. For most of projects it works fine, but when it comes to Workflows You cannot attach using Visual Studio to IIS worker process and debug it. You have to do it manually using command line:

VSPerfASPNetCmd.exe /s /o:profileName http://serverurl

You can find it in the filder:

%programfiles%\Microsoft Visual Studio 10.0\Team Tools\Performance Tools\

So it generates report in *.vsp file in working directory. Open it using Visual Studio 2010

This report allows to click through the Functions until You find the code line (if debug information is found) which caused the slow performance.

The bad thing I found is that time elapsed shows only in graph view. Later on You get information only about Exclusive and Inclusive samples.

I have successfully monitored page loads, events and even workflows so it is very useful tool for developers

WSS 3.0 / Sharepoint 2007 Multithreading

 

Today I am testing how multi threading will improve performance on different Sharepoint tasks

So the first thing to remember is, that SPSite and SPWeb are not thread safe and therefore have to create new instance of them in each Thread or there will be Sharepoint Exception

Microsoft.SharePoint.SPException: Attempted to make calls on more than one thread in single threaded mode.

Silverlight 4 un EntityFramework

Silverlight 4 un EntityFramework