/usr/src/usr.bin/gh-bc don't know how to make /usr/src/contrib/bc/locales/en_US.UTF-8.msg

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

/usr/src/usr.bin/gh-bc don't know how to make /usr/src/contrib/bc/locales/en_US.UTF-8.msg

Julian H. Stacey-3
Hi [hidden email],

/usr/src/usr.bin/gh-bc don't know how to make /usr/src/contrib/bc/locales/en_US.UTF-8.msg
With .ctm_status src-cur 14656 .svn_revision 364986 /usr/src/usr.bin/gh-bc

Avoided for now with /etc/src.conf WITHOUT_GH_BC=YES

Cheers,
Julian
--
Julian Stacey, Consultant Sys. Engineer, BSD Linux http://berklix.com/jhs/
Crash Brexit Dec. 2020 paid by speculators. http://berklix.uk/brexit/#money
Contraception V. Global warming, pollution, hunger, contagion, resource wars.
_______________________________________________
[hidden email] mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|

Re: /usr/src/usr.bin/gh-bc don't know how to make /usr/src/contrib/bc/locales/en_US.UTF-8.msg

Stefan Esser-3
Am 02.09.20 um 01:42 schrieb Julian H. Stacey:
> Hi [hidden email],
>
> /usr/src/usr.bin/gh-bc don't know how to make /usr/src/contrib/bc/locales/en_US.UTF-8.msg
> With .ctm_status src-cur 14656 .svn_revision 364986 /usr/src/usr.bin/gh-bc

Hi Julian,

since I'm building -CURRENT at least once a day with this bc
and there have been no other reports, this does appear to be
a local problem on your system (or a problem with CTM).

> Avoided for now with /etc/src.conf WITHOUT_GH_BC=YES

Yes, but the correct fix is to provide the missing file, which
is a symbolic link to en_US.msg. In fact, most of the message
catalogs are provided by symlinks (71 of 96 files in the locales
directory).

My assumption is, that CTM does not correctly encode and create
symbolic links, so you miss them ... (but I did not check the
CTM sources to verify that assumption).

This ought to be fixed in CTM and then a delta should be created
that provides these missing symlinks - since you are one of very
few CTM users left, you may want to create a patch ...

Since the mail list strips binary attachments, I'm including a
compresssed and uuencoded TAR file with these symlinks below.
Extract from within src/contrib/bc/locales to generate them:

begin 644 gh-bc-locales.tar.bz2
M0EIH.3%!6293618`G<P`#W!_D-"``)!``W_@/_?^D*?77I`$0``(4`/^TQ#A
M4(J+#)3TTTU(]0!#0Q-`:9`#09,14_T1E0&3(`!H:```9-`DU$%)#:@`````
M-#0!@````-``````4I*::@D_5/:IZGJ&)ZC(:`>IIH`'ZI[JAY5#VJAUJ'0S
MB5)<^7/.[OVC><;E,R%I@YC!.4$C!%0&\T"DP#,3(KT4RW8;8ZL<=^PJ'\5#
MMBEQ*ABH=RH=50RH94.NH<ZAM1`'("`>DD@:R,W/GV>3:MKS5-J$-83WJDS.
M)1%%A['191"3G$0\(S*S-#O-:6214=J+2@HJ,CILM%IM\<((&8``>!/:`2:D
M`UNUOI<D)5NO>K>%^6W9OX=W/T^/CPUIGHWXYQ\=I4-M:%0\]0^BH8J'XK\#
MO8SO8QF,X3FF939;&8.-0ZE0RH>JH>;DJ'ON,DNYPY9FOK!SW<\J'94-;]CL
M6M^I%DP@060$<&-XODQ>V8=20"BM(8:NE8B<)(!>+T9O4D`:<5G*7:#R20#-
MX2Y(!CAAV:S,Z0V--71:%+%-XN5>7>I(!F2`60,2JD1@+-54NJ)C#AQJ&HVV
MTWXU#THM];M^IOIIEF\-(+*24PU)`*M+=:<7JRV2`54-.&<===0X94.VH]TG
M:B\D76B^^G&>V7DL@]%87K];RF:UIIFK6M9K@>-1E'6G"M+5>2+3Y3U9GG1<
M65M3M1?DTG"H[?8,9,U)P>M?4J"P(OHDY2!**Z,5&+4D"H>1>,-@`P(<($XD
MY3WP^Y/=\8ASA=*BJX555YBB'.%PF`G,;A1$V!^BP`_)=0Z='LPS,F99VU#^
MR<JARJ&PRP6"P6"D2$57<(,I!05EF&;JAT=*AMMO4/,.CP5#@JMN.8S,S)EF
M6<ZA]I7#AL?=4.BH=]0["Y5#4G@_1^K&,SH9AF&8"@L&E$1$11B(BSC"'^D@
0"M>@D$#B+N2*<*$@+`$[F```
`
end

But since further symlinks will occur if more locales are added,
the problem will re-appear for CTM users, unless symlinks are
supported by CTM.

Regards, STefan

OpenPGP_signature (505 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: /usr/src/usr.bin/gh-bc don't know how to make /usr/src/contrib/bc/locales/en_US.UTF-8.msg

Julian H. Stacey-3
Thanks Stephan for your comprehensive analaysis,
i'll look into all this & reports back inc. CC current.

Cheers,
Julian
--
Julian Stacey, Consultant Sys. Engineer, BSD Linux http://berklix.com/jhs/
Crash Brexit Dec. 2020 paid by speculators. http://berklix.uk/brexit/#money
_______________________________________________
[hidden email] mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|

Re: /usr/src/usr.bin/gh-bc don't know how to make /usr/src/contrib/bc/locales/en_US.UTF-8.msg

Julian H. Stacey-3
In reply to this post by Stefan Esser-3
added cc: [hidden email] , [hidden email]

Summary of this mail below:
  I suspect I know where the problem is,
  Stephen & I will probably be able to resolve it.

Stefan Esser wrote:

> From: Stefan Esser <[hidden email]>
> To: "Julian H. Stacey" <[hidden email]>
> Cc: [hidden email], Gavin Howard <[hidden email]>
> Subject: Re: /usr/src/usr.bin/gh-bc don't know how to make
>  /usr/src/contrib/bc/locales/en_US.UTF-8.msg
>
> Am 02.09.20 um 01:42 schrieb Julian H. Stacey:
> > Hi [hidden email],
> >=20
> > /usr/src/usr.bin/gh-bc don't know how to make /usr/src/contrib/bc/local=
> es/en_US.UTF-8.msg
> > With .ctm_status src-cur 14656 .svn_revision 364986 /usr/src/usr.bin/gh=
> -bc
>
> Hi Julian,
>
> since I'm building -CURRENT at least once a day with this bc
> and there have been no other reports, this does appear to be
> a local problem on your system (or a problem with CTM).

Thanks Stefan, Yes, it seems a CTM problem.


> > Avoided for now with /etc/src.conf WITHOUT_GH_BC=3DYES
>
> Yes, but the correct fix is to provide the missing file, which
> is a symbolic link to en_US.msg. In fact, most of the message
> catalogs are provided by symlinks (71 of 96 files in the locales
> directory).
>
> My assumption is, that CTM does not correctly encode and create
> symbolic links, so you miss them ... (but I did not check the
> CTM sources to verify that assumption).

Yes, seems to be. I find no symbolic links in my local src-cur built
from CTM /pub/FreeBSD/branches/-current/src/src-cur.14600xEmpty.gz
up to src-cur.14662.gz which delivers /pub/FreeBSD/branches/-current/src/
.ctm_status src-cur 14662 .svn_revision 365330

Whereas both of
        svn export -q file:///usr/svn/base/head
        svn co -q file:///usr/svn/base/head
(working from a /usr/svn/ delivered by CTM
/pub/FreeBSD/development/CTM/svn-cur/svn-cur.09000xEmpty.xz
... /pub/FreeBSD/development/CTM/svn-cur/svn-cur.09025.xz )
deliver 132 symbolic links
of which 71 are shown by grep contrib/bc/locales/ | wc -l
(& 71 also in your uuencoded thanks)

The lack of symbolic links in CTM extracted trees was puzzling, as
I recall CTM had a problem a few months back not delivering symbolic
links, & Stephen (cc'd) solved it & issued patch deltas;
(around the time CTM moved from src/ to /usr/ports/misc/ctm/
but I can't recall the order of those two events off hand, doubtless in
ctm mail archive, (but I have to rush out soon))

My local @home CTM binary on my current box looks not old:
ls -l `which ctm`
 -r-xr-xr-x  1 root  wheel  39880 Aug 27 01:40 /usr/local/sbin/ctm*
cd /usr/local ;  find . -name ctm\* | sort | xargs ls -l

Then I realised I had blundered, & been extracting CTMs localy via
procmail automaticaly on an old box with
 -r-xr-xr-x  1 root  wheel  41224 Jun 14  2017 /usr/sbin/ctm*
but that was Not the solution as I still only get a single sym link
        FreeBSD-SVN/ports/hooks/pre-revprop-change
after re-extracting all ctm trees on my current box, with these commands:
 cd /data/tmp/ctm/1/FreeBSD-SVN
 ctm -q /pub/FreeBSD/development/CTM/svn-cur/svn-cur.09000xEmpty.xz
 ctm -q /pub/FreeBSD/development/CTM/svn-cur/svn-cur.08[0-9][0-9][0-9].xz

 cd /data/tmp/ctm/1/src-cur
 ctm -q /pub/FreeBSD/development/CTM/src-cur/src-cur.14600xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-cur/src-cur*.1[0-9][0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/ports-cur
 ctm -q /pub/FreeBSD/development/CTM/ports-cur/ports-cur.13600xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/ports-cur/ports-cur.1[0-9][0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-12
 ctm -q  /pub/FreeBSD/development/CTM/src-12/src-12.0800xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-12/src-12.[0-9][0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-11
 ctm -q /pub/FreeBSD/development/CTM/src-11/src-11.1700xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-11/src-11.[0-9][0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-10
 ctm -q /pub/FreeBSD/development/CTM/src-10/src-10.2100xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-10/src-10.[0-9][0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-9
 ctm -q /pub/FreeBSD/development/CTM/src-9/src-9.1900xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-9/src-9.[0-9][0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-8
 ctm -q /pub/FreeBSD/development/CTM/src-8/src-8.1900xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-8/src-8.[0-9][0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-7
 ctm -q /pub/FreeBSD/development/CTM/src-7/src-7.1700xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-7/src-7.[1-9][0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-6
 ctm -q /pub/FreeBSD/development/CTM/src-6/src-6.1600xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-6/src-6.1[0-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-5
 ctm -q /pub/FreeBSD/development/CTM/src-5/src-5.0800xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-5/src-5.0[6-9][0-9][0-9].gz
 
 cd /data/tmp/ctm/1/src-4
 ctm -q /pub/FreeBSD/development/CTM/src-4/src-4.2300xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-4/src-4.2[0-9][0-9][0-9].gz

My CTM bins on current box are modern,
cd /usr/local/sbin ; ls -l ctm* | grep -v pkgsave
 -r-xr-xr-x  1 root  wheel  39880 Aug 27 01:40 ctm*
 -r-xr-xr-x  1 root  wheel  10968 Aug 27 01:40 ctm_dequeue*
 -r-xr-xr-x  1 root  wheel  18032 Aug 27 01:40 ctm_rmail*
 -r-xr-xr-x  1 root  wheel  14904 Aug 27 01:40 ctm_smail*

but were from pkg install, so in case anything went wrong on pkg builder
@freebsd.org, I rebuilt localy:
 cd /usr/ports ;
 cat .ctm_status ports-cur 13646
 cat .svn_revision 547299
 cd /usr/ports/misc/ctm ; make install
 cd /usr/local/sbin ; ls -l ctm* | grep -v pkgsave
  -r-xr-xr-x  1 root  wheel  39880 Sep  5 13:07 ctm*
  -r-xr-xr-x  1 root  wheel  10968 Sep  5 13:07 ctm_dequeue*
  -r-xr-xr-x  1 root  wheel  18032 Sep  5 13:07 ctm_rmail*
  -r-xr-xr-x  1 root  wheel  14904 Sep  5 13:07 ctm_smail*

& re extracted with
 cd /data/tmp/ctm/2/src-cur
 ctm -q /pub/FreeBSD/development/CTM/src-cur/src-cur.14600xEmpty.gz
 ctm -q /pub/FreeBSD/development/CTM/src-cur/src-cur*.1[0-9][0-9][0-9][0-9].gz
 find . -type l -print
& still no symbolic links
 

> This ought to be fixed in CTM and then a delta should be created
> that provides these missing symlinks - since you are one of very
> few CTM users left, you may want to create a patch ...

Yes, I haven't looked yet on host of http://ctm.berklix.org (which
is the global master generator site forr FreeBSD CTM deltas. The
host is mine, but it's Stephen who is the CTM generator master &
knows scripts & paths where to look etc).

> ... Trimmed ..
> But since further symlinks will occur if more locales are added,
> the problem will re-appear for CTM users, unless symlinks are
> supported by CTM.

Yes, symbolic links are supposed to be supported by CTM now, Stephen
knows more about symlinks on CTM than me, On host ctm.berklix.org
`which ctm` # /usr/sbin/ctm & I see both
        44096 Mar 13 17:56 /usr/sbin/ctm*
        44000 Apr  7 13:01 /usr/local/sbin/ctm*
& ctm.berklix.org is a jail 12.1-p8 whose prison was recently upgraded,
& its src-12 still contains
        ./usr.sbin/ctm
        ./usr.sbin/ctm/ctm
        ./usr.sbin/ctm/ctm_dequeue
        ./usr.sbin/ctm/ctm_rmail
        ./usr.sbin/ctm/ctm_smail

I or Stephen need to check if:
  maybe some of the ctm generator scripts might have been till
  recently taking default path to ctm bins, & running a newer ctm
  in local/ from ports that could do sym links, & maybe I had just
  manually removed old /usr/sbin/ctm* ; but since the prison upgrade
  (or earlier) ctm.berklix.org generator might now be running from
  older /usr/sbin/ctm without sym link capability.

I'm not familiar with paths to CTM generator scripts to trace that,
& scripts names are opaque so while it would be trivial for me to
remove the old /usr/sbin/ctm* to force scripts to use /usr/local
or break, that will not be sufficient as we will need to regenerate
some trees & deltas. That's where Stephen Montgomery-Smith's
familiarity with trees & scripts is very valuable.  If Stephen is
not available, it will need to wait as I'm about to travel.

> Regards, STefan
Thanks Stefan.

Cheers,
Julian
--
Julian Stacey, Consultant Sys. Engineer, BSD Linux http://berklix.com/jhs/
Crash Brexit Dec. 2020 paid by speculators. http://berklix.uk/brexit/#money
Probe Russian Brexit Referendum https://petition.parliament.uk/petitions/332293
_______________________________________________
[hidden email] mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "[hidden email]"