1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
|
#
# CDDL HEADER START
#
# The contents of this file are subject to the terms of the
# Common Development and Distribution License (the "License").
# You may not use this file except in compliance with the License.
#
# You can obtain a copy of the license at usr/src/OPENSOLARIS.LICENSE
# or http://www.opensolaris.org/os/licensing.
# See the License for the specific language governing permissions
# and limitations under the License.
#
# When distributing Covered Code, include this CDDL HEADER in each
# file and include the License file at usr/src/OPENSOLARIS.LICENSE.
# If applicable, add the following below this CDDL HEADER, with the
# fields enclosed by brackets "[]" replaced with your own identifying
# information: Portions Copyright [yyyy] [name of copyright owner]
#
# CDDL HEADER END
#
#
# Copyright (c) 1999, 2010, Oracle and/or its affiliates. All rights reserved.
This directory contains the tools used to do a full build of the
OS/Net workspace. They usually live in the /opt/onbld directory on build
machines. From here, 'make install' will build and install the tools
in $ROOT/opt/onbld.
Layout of /opt/onbld
--------------------
/opt/onbld/etc/abi
contains Solaris ABI database (ABI_*.db) and exceptions
for ABI Auditing tool (interface_check, interface_cmp).
/opt/onbld/bin
basic bin directory - contains scripts.
/opt/onbld/bin/${MACH}
architecture-specific bin directory for binaries.
/opt/onbld/env
build environment files.
/opt/onbld/lib
libraries used by the build tools.
/opt/onbld/lib/python<version>/
python modules used by the build tools.
/opt/onbld/lib/python<version>/onbld/hgext
Mercurial extensions.
/opt/onbld/lib/python/
symlink to the modules directory of the currently preferred
python version. This exists to retain compatibility both for
tools expecting only one supported version of python, and for
user .hgrc files that expect to find cdm.py in
/opt/onbld/lib/python/onbld/hgext.
/opt/onbld/man
rudimentary man pages for some of the tools.
Tool Summary
------------
bldenv
companion to 'nightly.' Takes the same environment file you
used with 'nightly,' and starts a shell with the environment
set up the same way as 'nightly' set it up. This is useful
if you're trying to quickly rebuild portions of a workspace
built by 'nightly'. 'ws' should not be used for this since it
sets the environment up differently and may cause everything
to rebuild (because of different -I or -L paths).
build_cscope
builds cscope databases in the uts, the platform subdirectories
of uts, and in usr/src. Uses cscope-fast.
cdm
A Mercurial extension providing various commands useful for ON
development
check_rtime
checks ELF attributes used by ELF dynamic objects in the proto area.
Used by 'nightly's -r option, to check a number of ELF runtime
attributes for consistency with common build rules. nightly uses
the -o option to simplify the output for diffing with previous
build results. It also uses the -i option to obtain NEEDED and RUNPATH
entries, which help detect changes in software dependencies and makes
sure objects don't have any strange runpaths like /opt/SUNWspro/lib.
codereview
Given two filenames, creates a postscript file with the file
differences highlighted.
codesign
Tools for signing cryptographic modules using the official
Sun release keys stored on a remote signing server. This
directory contains signit, a client program for signing
files with the signing server; signproto, a shell script
that finds crypto modules in $ROOT and signs them using
signit; and codesign_server.pl, the code that runs on the
server. The codesign_server code is not used on an ON
build machine but is kept here for source control purposes.
copyrightchk
Checks that files have appropriate SMI copyright notices.
Primarily used by wx
cscope-fast
The fast version of cscope that we use internally. Seems to work,
but may need more testing before it's placed in the gate. The source
just really needs to be here.
cstyle
checks C source for compliance with OS/Net guidelines.
ctfconvert
Convert symbolic debugging information in an object file to the Compact
ANSI-C Type Format (CTF).
ctfdump
Decode and display CTF data stored in a raw file or in an ELF file.
ctfmerge
Merge the CTF data from one or more object files.
depcheck
A tool to try an assess the dependencies of executables. This tool
is not a definitive dependency check, but it does use "strings" and
"ldd" to gather as much information as it can. The dependency check
tool can handle filenames and pkgnames. Before using the dependency
checker you must build a database which reflects the properties and
files in your system.
elfcmp
Compares two ELF modules (e.g. .o files, executables) section by
section. Useful for determining whether "trivial" changes -
cstyle, lint, etc - actually changed the code. The -S option
is used to test whether two binaries are the same except for
the elfsign signature.
find_elf
Search a directory tree for ELF objects, and produce one line of
output per object. Used by check_rtime and interface_check to locate
the objects to examine.
findunref
Finds all files in a source tree that have access times older than a
certain time and are not in a specified list of exceptions. Since
'nightly' timestamps the start of the build, and findunref uses its
timestamp (by default), this can be used to find all files that were
unreferenced during a nightly build). Since some files are only used
during a SPARC or Intel build, 'findunref' needs to be run on
workspaces from both architectures and the results need to be merged.
For instance, if $INTELSRC and $SPARCSRC are set to the usr/src
directories of your Intel and SPARC nightly workspaces, then you
can merge the results like so:
$ findunref $INTELSRC $INTELSRC/tools/findunref/exception_list | \
sort > ~/unref-i386.out
$ findunref $SPARCSRC $SPARCSRC/tools/findunref/exception_list | \
sort > ~/unref-sparc.out
$ comm -12 ~/unref-i386.out ~/unref-sparc.out > ~/unref.out
hdrchk
checks headers for compliance with OS/Net standards (form, includes,
C++ guards).
hgsetup
creates a basic Mercurial configuration for the user.
hg-active
helper used by webrev to generate file lists for Mercurial
workspaces.
install.bin
binary version of /usr/sbin/install. Used to be vastly faster
(since /usr/sbin/install is a shell script), but may only be a bit
faster now. One speedup includes avoiding the name service for the
well-known, never-changing password entries like 'root' and 'sys.'
interface_check
detects and reports invalid versioning in ELF objects.
Optionally generates an interface description file for
the workspace.
interface_cmp
Compares two interface description files, as produced by
interface_check, and flags invalid deviations in ELF object
versioning between them. interface_cmp can be used between Solaris
gates to ensure that older releases remain compatible with the
development gate. It can also be used to validate new changes to
the development gate before they are integrated.
lintdump
dumps the contents of one or more lint libraries; see lintdump(1)
ndrgen
Network Data Language (NDL) RPC protocol compiler to support DCE
RPC/MSRPC and SMB/CIFS. ndrgen takes an input protocol definition
file (say, proto.ndl) and generates an output C source file
(proto_ndr.c) containing the Network Data Representation (NDR)
marshalling routines to implement the RPC protocol.
nightly
nightly build script. Takes an environment (or 'env') file describing
such things as the workspace, the parent, and what to build. See
env/developer and env/gatekeeper for sample, hopefully well-commented
env files.
protocmp
compares proto lists and the package definitions. Used by nightly
to determine if the proto area matches the packages, and to detect
differences between a childs proto area and a parents.
protocmp.terse
transforms the output of protocmp into something a bit more friendly
protolist
create a list of what's in the proto area, to feed to protocmp.
ws
creates a shell with the environment set up to build in the given
workspace. Used mostly for non-full-build workspaces, so it sets up
to pull headers and libraries from the proto area of the parent if
they aren't in the childs proto area.
tokenize
Used to build the sun4u boot block.
webrev
Generates a set of HTML pages that show side-by-side diffs of
changes in your workspace, for easy communication of code
review materials. Can automagically find edited files or use a
manually-generated list; knows how to use wx's active file for
lists of checked-out files and proposed SCCS comments.
which_scm
Reports the current Source Code Management (SCM) system in use
and the top-level directory of the workspace.
wsdiff
Detect object differences between two ON proto areas. Used by
nightly(1) to determine what changed between two builds. Handy
for identifying the set of built objects impacted by a given
source change. This information is needed for patch construction.
How to do a full build
----------------------
1. Find an environment file that might do what you want to do. If you're just
a developer wanting to do a full build in a child of the gate, copy the
'developer' environment file to a new name (private to you and/or the
work being done in this workspace, to avoid collisions with others). Then
edit the file and tailor it to your workspace. Remember that this file
is a shell script, so it can do more than set environment variables.
2. Run 'nightly' and give it your environment file as an
option. 'nightly' will first look for your environment file in
/opt/onbld/env, and if it's not there then it will look for it as an
absolute or relative path. Some people put their environment files in
their workspace to keep them close.
3. When 'nightly' is complete, it will send a summary of what happened to
$MAILTO. Usually, the less info in the mail the better. If you have failures,
you can go look at the full log of what happened, generally in
$CODEMGR_WS/log/log.<date>/nightly.log (the mail_msg it sent and the proto
list are there too). You can also find the individual build logs, like
'make clobber' and 'make install' output in $SRC, under names like
clobber-${MACH}.out and install-${MACH}.out (for a DEBUG build). These
will be smaller than nightly.log, and maybe more searchable.
Files you have to update to add a tool
--------------------------------------
1. Add the tool in its appropriate place.
2. Update the Makefile as required.
3. Update usr/src/pkg/manifests/developer-build-onbld.mf
4. Update usr/src/tools/README.tools (this file).
5. Repeat 1-4 for any man pages.
|
