Port-sparc64 archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

Re: Tracing NetBSD sun4v issues



On 10/20/26 02:00, Sad Clouds wrote:
On Mon, 19 Oct 2026 19:03:53 +0000 (UTC)
Palle Lyckegaard <palle%netbsd.org@localhost> wrote:

Is your system using api version 1 I wonder...

# ldm -V

Logical Domains Manager (v 3.3.0.0.17)
         Hypervisor control protocol v 1.7
         Using Hypervisor MD v 1.4

System PROM:
         Hypervisor      v. 1.10.7.      @(#)Hypervisor 1.10.7.h 2016/03/11 07:13\015

         OpenBoot        v. 4.33.6.      @(#)OpenBoot 4.33.6.g 2016/03/11 06:05


Slightly newer ( higher number? ) revisions here :

neptune# uname -a
SunOS neptune 5.11 11.4.90.212.0 sun4v sparc sun4v non-virtualized

neptune# ldm -V

Logical Domains Manager (v 3.6.2.0.90)
        Hypervisor control protocol v 1.16
        Using Hypervisor MD v 1.4

System Firmware:
        Sun System Firmware 9.10.10.a 2025/06/18 08:28

System PROM:
Hostconfig v. 1.11.14 @(#)Hostconfig 1.11.14 2025/02/17 04:02 Hypervisor ROM v. 1.20.6.g @(#)Hypervisor 1.20.6.g 2025/02/17 03:27 OpenBoot v. 4.43.14 @(#)OpenBoot 4.43.14 2025/02/17 03:22
neptune#

Well the Machine Description "Hypervisor MD v 1.4" is the same.

At the moment I think that Solaris is a tad confused about what the
hardware inventory is :

neptune# ldm list-devices -a
CORE
    ID      %FREE   CPUSET
    0       0      (0, 1, 2, 3, 4, 5, 6, 7)
    1       0      (8, 9, 10, 11, 12, 13, 14, 15)
    2       0      (16, 17, 18, 19, 20, 21, 22, 23)
    3       0      (24, 25, 26, 27, 28, 29, 30, 31)
    8       0      (64, 65, 66, 67, 68, 69, 70, 71)
    9       0      (72, 73, 74, 75, 76, 77, 78, 79)
    10      0      (80, 81, 82, 83, 84, 85, 86, 87)
    11      0      (88, 89, 90, 91, 92, 93, 94, 95)
    64      0      (512, 513, 514, 515, 516, 517, 518, 519)
    65      0      (520, 521, 522, 523, 524, 525, 526, 527)
    66      0      (528, 529, 530, 531, 532, 533, 534, 535)
    67      0      (536, 537, 538, 539, 540, 541, 542, 543)
    72      0      (576, 577, 578, 579, 580, 581, 582, 583)
    73      0      (584, 585, 586, 587, 588, 589, 590, 591)
    74      0      (592, 593, 594, 595, 596, 597, 598, 599)
    75      0      (600, 601, 602, 603, 604, 605, 606, 607)

VCPU
    PID     %FREE   PM
    0       0       no
    1       0       no
    2       0       no
    3       0       no
    4       0       no
    5       0       no
    6       0       no
    7       0       no
    8       0       no
    9       0       no
    10      0       no
    11      0       no
    12      0       no
    13      0       no
    14      0       no
    15      0       no
    16      0       no
    17      0       no
    18      0       no
    19      0       no
    20      0       no
    21      0       no
    22      0       no
    23      0       no
    24      0       no
    25      0       no
    26      0       no
    27      0       no
    28      0       no
    29      0       no
    30      0       no
    31      0       no
    64      0       no
    65      0       no
    66      0       no
    67      0       no
    68      0       no
    69      0       no
    70      0       no
    71      0       no
    72      0       no
    73      0       no
    74      0       no
    75      0       no
    76      0       no
    77      0       no
    78      0       no
    79      0       no
    80      0       no
    81      0       no
    82      0       no
    83      0       no
    84      0       no
    85      0       no
    86      0       no
    87      0       no
    88      0       no
    89      0       no
    90      0       no
    91      0       no
    92      0       no
    93      0       no
    94      0       no
    95      0       no
    512     0       no
    513     0       no
    514     0       no
    515     0       no
    516     0       no
    517     0       no
    518     0       no
    519     0       no
    520     0       no
    521     0       no
    522     0       no
    523     0       no
    524     0       no
    525     0       no
    526     0       no
    527     0       no
    528     0       no
    529     0       no
    530     0       no
    531     0       no
    532     0       no
    533     0       no
    534     0       no
    535     0       no
    536     0       no
    537     0       no
    538     0       no
    539     0       no
    540     0       no
    541     0       no
    542     0       no
    543     0       no
    576     0       no
    577     0       no
    578     0       no
    579     0       no
    580     0       no
    581     0       no
    582     0       no
    583     0       no
    584     0       no
    585     0       no
    586     0       no
    587     0       no
    588     0       no
    589     0       no
    590     0       no
    591     0       no
    592     0       no
    593     0       no
    594     0       no
    595     0       no
    596     0       no
    597     0       no
    598     0       no
    599     0       no
    600     0       no
    601     0       no
    602     0       no
    603     0       no
    604     0       no
    605     0       no
    606     0       no
    607     0       no

MEMORY
    PA                   SIZE            BOUND
    0x0                  60M             _sys_
    0x3c00000            32M             _sys_
    0x5c00000            94M             _sys_
    0xba00000            1030M           _sys_
    0x4c000000           64M             _sys_
    0x50000000           129536M         primary
    0x1ff0000000         128M            _sys_
    0x1ff8000000         64M             _sys_
    0x1ffc000000         64M             _sys_
    0x400000000000       130816M         primary
    0x401ff0000000       192M            _sys_
    0x401ffc000000       64M             _sys_

IO
    DEVICE                           PSEUDONYM        BOUND   OPTIONS
    pci@300                          pci_0            yes
    pci@302                          pci_2            yes
PCIEDEV
    pci@300/pci@2/pci@0/pci@13       /SYS/MB/RISER3/PCIE3 yes
    pci@300/pci@1/pci@0/pci@1        /SYS/MB/NET0     yes
    pci@300/pci@2/pci@0/pci@4        /SYS/DBP/NVME0   yes
    pci@300/pci@2/pci@0/pci@5        /SYS/DBP/NVME1   yes
    pci@302/pci@1/pci@0/pci@11       /SYS/MB/RISER1/PCIE1 yes
    pci@302/pci@1/pci@0/pci@12       /SYS/MB/RISER2/PCIE2 yes
    pci@302/pci@2/pci@0/pci@14       /SYS/MB/RISER3/PCIE4 yes
    pci@302/pci@2/pci@0/pci@6        /SYS/DBP/NVME2   yes
    pci@302/pci@2/pci@0/pci@7        /SYS/DBP/NVME3   yes
IOVDEV


The CPU CORE list is bizarre. There are two sockets in there and the
numbers make sense in that they are in order :

neptune# psrinfo -pv
The physical processor has 8 cores and 64 virtual processors (0-63)
  The core has 8 virtual processors (0-7)
  The core has 8 virtual processors (8-15)
  The core has 8 virtual processors (16-23)
  The core has 8 virtual processors (24-31)
  The core has 8 virtual processors (32-39)
  The core has 8 virtual processors (40-47)
  The core has 8 virtual processors (48-55)
  The core has 8 virtual processors (56-63)
    SPARC-S7 (chipid 0, clock 4267 MHz)
The physical processor has 8 cores and 64 virtual processors (64-127)
  The core has 8 virtual processors (64-71)
  The core has 8 virtual processors (72-79)
  The core has 8 virtual processors (80-87)
  The core has 8 virtual processors (88-95)
  The core has 8 virtual processors (96-103)
  The core has 8 virtual processors (104-111)
  The core has 8 virtual processors (112-119)
  The core has 8 virtual processors (120-127)
    SPARC-S7 (chipid 1, clock 4267 MHz)

I will slice this up and create a smaller 4 CPU chunk for Solaris 11.4
with no more than 64G of memory. It is full of SAS disks and I want to
ensure that ZFS cache operations are swift. The NetBSD LDOM will be some
small 2 CPU ( 16 core ) thing with 32G of memory. However the ZFS volume
for it should likely be 256G to allow room for source builds of stuff.

Any suggestions would be welcome.

What is the test image du jour?  Same installer image as usual?

--
--
Dennis Clarke
RISC-V/SPARC/PPC/ARM/CISC
UNIX and Linux spoken


Home | Main Index | Thread Index | Old Index