tag:blogger.com,1999:blog-13518440.post3587139877821083075..comments2023-12-12T04:39:52.103-08:00Comments on TSMAdmin: TSM Backup IssueChad Smallhttp://www.blogger.com/profile/02637281120881655693noreply@blogger.comBlogger21125tag:blogger.com,1999:blog-13518440.post-51098669449585863982019-12-22T23:47:37.352-08:002019-12-22T23:47:37.352-08:00Interesting case, have you found the cause?Interesting case, have you found the cause?Philiphttps://www.nakivo.com/incremental-backup/noreply@blogger.comtag:blogger.com,1999:blog-13518440.post-16995345030954276712016-05-24T12:25:37.920-07:002016-05-24T12:25:37.920-07:00you change de data base in solid disk for incremen...you change de data base in solid disk for increment the o performance Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-13518440.post-9781108864138097362013-02-06T07:13:54.591-08:002013-02-06T07:13:54.591-08:00Hi Chad,
I have tsm server at 6.2.4.0 and OS is a...Hi Chad,<br /><br />I have tsm server at 6.2.4.0 and OS is aix. Now i have 2 client nodes which is taking long time to complete its systemstate backup when doing its daily incremental backup . <br />The client OS is windows-2008 and has BA client version:6.2.1.3.<br /><br />Impact:actually my data expiration is taking almost 24 hours to complete and it is overlapping the next day schedule as previous process is still running , now checking the expiration activity from the summary table i found that 2 wintel nodes which is starting as per the daily admin schedule in the morning but getting completed the next day morning , sometime till afternoon . And now when i check those two nodes it has a two diff schedule one for normal fs backup and the other is for taking a system state object <br /><br /><br /><br />some thing like this<br /> *******************************************<br />tsm>q assoc G0_WIN TEMP_SYSSTATE<br /><br />Policy Domain Name Schedule Name Associated Nodes<br />------------------------------ ------------------------------ ----------------------------------------------------------------<br />G0_WIN TEMP_SYSSTATE PRS02991 PRS04811<br /><br />tsm: >q sched n=PRS02991 f=d<br /><br /> Policy Domain Name: G0_WIN<br /> Schedule Name: G0_WIN_INC_2000<br /> Description: NON-LIVE Schedule<br /> Action: Incremental<br /> Subaction:<br /> Options:<br /> Objects:<br /> Priority: 5<br /> Start Date/Time: 05/20/11 20:00:00<br /> Duration: 4 Hour(s)<br /> Schedule Style: Classic<br /> Period: 1 Day(s)<br /> Day of Week: Any<br /> Month:<br /> Day of Month:<br /> Week of Month:<br /> Expiration:<br />Last Update by (administrator): IN026082<br /> Last Update Date/Time: 08/10/12 13:22:47<br /> Associated Nodes: PRS02991<br /> Managing profile:<br /><br /> Policy Domain Name: G0_WIN<br /> Schedule Name: TEMP_SYSSTATE<br /> Description: Schedule for SYSTEMSTATE Backup<br /> Action: Backup<br /> Subaction: Systemstate<br /> Options:<br /> Objects:<br /> Priority: 5<br /> Start Date/Time: 11/23/12 17:30:00<br /> Duration: 15 Minute(s)<br /> Schedule Style: Classic<br /> Period: 1 Day(s)<br /> Day of Week: Any<br /> Month:<br /> Day of Month:<br /> Week of Month:<br /> Expiration:<br />Last Update by (administrator): IN005166<br /> Last Update Date/Time: 11/23/12 16:31:08<br />more... ( to continue, 'C' to cancel)<br /><br /> Associated Nodes: PRS02991<br /> Managing profile:<br /><br /><br /><br /><br />******************************************<br /><br />NODE details : <br /><br />PRS04811 --development<br /><br />PRS2991 --> production<br /><br />OS level =Windows 2008 , R2 Standard, SP 1<br />Memory 12 Gb , Virtual Server , 2 cpu with 2.7Ghz.<br /><br />RMDV application is running .<br /><br />1Gps full du-plex .<br /><br />Autonegotiation <br /><br /><br /><br /><br />Client Version: Version 6, release 2, level 1.3<br /><br /><br />*****************************<br /><br />Can you please help me in this resolving this ..or any hint ..Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-13518440.post-6395741501419361832012-11-03T09:57:37.460-07:002012-11-03T09:57:37.460-07:00Hi Chad,
Did you get to the bottom of this? I am e...Hi Chad,<br />Did you get to the bottom of this? I am experiencing the same issue on a TSM 6.2.4 Windows 2008 R2 (no SP1) environment.IvorBlogNowhttps://www.blogger.com/profile/01935719772263861665noreply@blogger.comtag:blogger.com,1999:blog-13518440.post-69593767503240218592012-09-21T09:01:05.299-07:002012-09-21T09:01:05.299-07:00We had similar problem, seeing exact same number o...We had similar problem, seeing exact same number of "Receive Errors" and "DMA Overrun" errors.<br /><br />Our admin found our TSM Server was running with these AIX default values:<br /> rfc1323 = 0<br /> tcp_recvspace = 16384<br /> tcp_sendspace = 16384<br /><br />This is significantly smaller than necessary for adequate throughput with our network setup (we also have 802.3ad bonded link). He followed the "TSM Performance Tuning Guide v6.2" (GC23-9788-02) which states on pages 6-7 (22-23/90 in pdf) that AIX should use minimum 64KB window, instead of 16KB.<br /><br />Here is the AIX config now, with greatly improved throughput:<br /> rfc1323 = 1<br /> tcp_recvspace = 64512<br /> tcp_sendspace = 64512<br /><br />Hope this helps!<br /><br />Robert L.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-13518440.post-59190520658411406742012-03-08T09:41:49.350-08:002012-03-08T09:41:49.350-08:00We're having a similar problem, and have so fa...We're having a similar problem, and have so far tracked it down to the client side.<br /><br />Try using iperf. Run iperf -s on the tsm server, and "iperf -c -l 1M -w 10M $tsmname". This will tell you how the link is working between client and server. Iperf will either eliminate or spotlight the network between client and server.<br /><br />Assuming you're writing to disk pools, be sure to test your disk w/ something like dd.<br /><br />Keep in mind that LACP is not a load balancing protocol. If this client is one IP, then it's only talking to one port in your LACP interface in one VIO server.<br /><br />On the DMA overrun, we see this regularly, but interestingly, it's when the adapters are congesting at @ 107-109MB/s.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-13518440.post-59801173533135261282012-02-20T04:23:43.501-08:002012-02-20T04:23:43.501-08:00Hi.
Did You consider that issue can be on node DB ...Hi.<br />Did You consider that issue can be on node DB side. <br />Please try to transfer (archive) 50GB before, at this same time and after db backup.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-13518440.post-36636375045375807182012-02-18T15:07:32.693-08:002012-02-18T15:07:32.693-08:00I have same issue with TSM 6.2.1I have same issue with TSM 6.2.1Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-13518440.post-60033333398768545802012-01-26T09:00:28.351-08:002012-01-26T09:00:28.351-08:00Interestingly enough I didn't notice the DMA o...Interestingly enough I didn't notice the DMA overruns, getting caught up in the interrupt amount. I'll definitely look into that because I am seeing it on all my TSM servers in the Power 6 frame. I think we may need to tweak the VIO servers settings.Chad Smallhttps://www.blogger.com/profile/02637281120881655693noreply@blogger.comtag:blogger.com,1999:blog-13518440.post-49750752377881676872012-01-26T01:41:22.108-08:002012-01-26T01:41:22.108-08:00Hi,
DMA Overrun: 691 indicates that your pci-bus ...Hi, <br />DMA Overrun: 691 indicates that your pci-bus is overloaded or it has not enough CPU to handle the 4GB network adapter on your system.cilesiznoreply@blogger.comtag:blogger.com,1999:blog-13518440.post-27868826888088243742012-01-24T15:08:50.880-08:002012-01-24T15:08:50.880-08:0036.3MB/sec * 8b/B = 290.4Mb/s
So...assuming the s...36.3MB/sec * 8b/B = 290.4Mb/s<br /><br />So...assuming the system is running flat-out all the time, you might be maxing out a GigE connection there.<br /><br />What mode is that aggregated link?Tom Kylehttp://lanigera.com/wordpressnoreply@blogger.comtag:blogger.com,1999:blog-13518440.post-89295841245569162632012-01-24T14:43:36.910-08:002012-01-24T14:43:36.910-08:00Well if you take
38,060,151bytes /1024 (KB) /102...Well if you take <br /><br />38,060,151bytes /1024 (KB) /1024 (MB) = 36.3MB/secChad Smallhttps://www.blogger.com/profile/02637281120881655693noreply@blogger.comtag:blogger.com,1999:blog-13518440.post-2425317802966603212012-01-24T14:32:19.122-08:002012-01-24T14:32:19.122-08:00Check my math, here's what I'm getting fro...Check my math, here's what I'm getting from your posted entstat output:<br /><br />9 days 19 hours 20 minutes 35 seconds<br /><br />((9 * 24) + 19) * 60 + 20) * 60 + 35 = 847235 seconds<br /><br />32245892708954 bytes / 847235 seconds = 38,060,151 bytes/sec<br /><br />Average network throughput of 290.4 Mb/sTom Kylehttp://lanigera.com/wordpressnoreply@blogger.comtag:blogger.com,1999:blog-13518440.post-23251819206077245312012-01-24T14:21:01.535-08:002012-01-24T14:21:01.535-08:00Transfering a 1GB file across the backup network a...Transfering a 1GB file across the backup network averaged 17.4MB per second. No errors.Chad Smallhttps://www.blogger.com/profile/02637281120881655693noreply@blogger.comtag:blogger.com,1999:blog-13518440.post-85071952651612718242012-01-24T13:57:33.911-08:002012-01-24T13:57:33.911-08:00We cleared the stats and immediately the receive i...We cleared the stats and immediately the receive interrupts immediately started moving up. I tried the ftp but nothing conclusive.Chad Smallhttps://www.blogger.com/profile/02637281120881655693noreply@blogger.comtag:blogger.com,1999:blog-13518440.post-41892585876564365432012-01-24T12:32:21.154-08:002012-01-24T12:32:21.154-08:00Hi Chad,
As always, first question is: what chang...Hi Chad,<br /><br />As always, first question is: what changed?<br /><br />If you can, try ivorblognow's suggestion and copy a large file over via FTP or scp. That takes TSM and the DB out of the equation.<br /><br />Also, can you clear the stats (entstat -r) and see what kind of rate you are getting? Not sure if the interrupts are anything to be concerned about.<br /><br />Also also, what is the output for `entstat -p tcp `?<br /><br />Good luck,<br /><br />TomTom Kylehttp://lanigera.com/wordpressnoreply@blogger.comtag:blogger.com,1999:blog-13518440.post-57064475707339066792012-01-24T07:46:01.043-08:002012-01-24T07:46:01.043-08:00The problem is with the backup server not my clien...The problem is with the backup server not my clients. All my clients are being affected by this and it seems to be occurring on ALL my TSM servers on the backup network VLAN. The network Admins say they don't see any errors, so I'm left with the settings in AIX. Any ideas what I should look at?Chad Smallhttps://www.blogger.com/profile/02637281120881655693noreply@blogger.comtag:blogger.com,1999:blog-13518440.post-59169080519390612892012-01-24T06:36:03.393-08:002012-01-24T06:36:03.393-08:00Please put your .opt and .sys files and also raise...Please put your .opt and .sys files and also raise a query system<br /> backup direct on tape/disk .....<br /><br /> and any relevant info<br /><br /> txsjvde.behttps://www.blogger.com/profile/00024518371375855938noreply@blogger.comtag:blogger.com,1999:blog-13518440.post-45777156159767660882012-01-24T06:34:47.160-08:002012-01-24T06:34:47.160-08:00Please put your .opt and .sys files and also rais...Please put your .opt and .sys files and also raise a query system<br />backup direct on tape/disk .....<br /><br />and any relevant info<br /><br />txsAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-13518440.post-82774182026022335512012-01-24T06:32:55.427-08:002012-01-24T06:32:55.427-08:00can you please pout your options files (.sys and ....can you please pout your options files (.sys and .opt) and a query system ?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-13518440.post-87010238531121163352012-01-24T02:47:21.927-08:002012-01-24T02:47:21.927-08:00HI Chad,
Have you tried an FTP copy from source t...HI Chad,<br /><br />Have you tried an FTP copy from source to TSM to heck the through put is what you imagined?Anonymousnoreply@blogger.com