Compare commits
111
Commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
28b2c18604 | ||
|
|
21a39618d3 | ||
|
|
7f3b5def0f | ||
|
|
30c9943bad | ||
|
|
5a91f66402 | ||
|
|
0db25812f2 | ||
|
|
63f00e44c5 | ||
|
|
d55725332e | ||
|
|
3a9eee19d1 | ||
|
|
02dfc794c4 | ||
|
|
e1355bcb70 | ||
|
|
a489f077c9 | ||
|
|
15cdb861ff | ||
|
|
854bfe5c4b | ||
|
|
7917d23d6e | ||
|
|
c3d6c06910 | ||
|
|
683b15e073 | ||
|
|
190f95b632 | ||
|
|
54e42c072c | ||
|
|
77049eb026 | ||
|
|
f87e3642f6 | ||
|
|
bebf85814e | ||
|
|
ea9df52bc3 | ||
|
|
62adf7f937 | ||
|
|
35d8e08871 | ||
|
|
693dbccc9d | ||
|
|
2ea23d9bce | ||
|
|
87926d9622 | ||
|
|
aa8b84c8cd | ||
|
|
7739abd105 | ||
|
|
dfdfccc460 | ||
|
|
4ae6fa7b2e | ||
|
|
3aa5c7a432 | ||
|
|
bc44d60d18 | ||
|
|
a64c04a128 | ||
|
|
c3e48aac56 | ||
|
|
40c41f2734 | ||
|
|
58189bae3a | ||
|
|
745a8eed9b | ||
|
|
7f43cf238b | ||
|
|
95a05a0631 | ||
|
|
24a4ca6970 | ||
|
|
c51c9d71e1 | ||
|
|
7008e14972 | ||
|
|
668f1bb118 | ||
|
|
019f317a82 | ||
|
|
20c48f04b9 | ||
|
|
3bae24b930 | ||
|
|
1714257c89 | ||
|
|
949a0f9c8d | ||
|
|
f2a80475a5 | ||
|
|
7c2e286c9d | ||
|
|
5325a8f9a4 | ||
|
|
71b640085a | ||
|
|
dcf9e280d0 | ||
|
|
e4f40e7c0f | ||
|
|
4dc526c4b0 | ||
|
|
15f1843cde | ||
|
|
8cdeb3db2e | ||
|
|
4fdc7b48fd | ||
|
|
de8b8ee678 | ||
|
|
5cf2b8ee8c | ||
|
|
04d5095e44 | ||
|
|
ce4f9ad481 | ||
|
|
41dc3ea2ea | ||
|
|
c03add4868 | ||
|
|
d73de3d01c | ||
|
|
14a3cbe121 | ||
|
|
4313d58471 | ||
|
|
db9fbd71d4 | ||
|
|
1802dac07a | ||
|
|
9b2af3bb50 | ||
|
|
99bbd566cf | ||
|
|
3f793afd34 | ||
|
|
05ba3942a2 | ||
|
|
d46c50a2db | ||
|
|
964006ec6d | ||
|
|
0c82da7a1d | ||
|
|
93a4f808bf | ||
|
|
7a58f37d9f | ||
|
|
b727284ef3 | ||
|
|
396848e898 | ||
|
|
55926b8dc4 | ||
|
|
ee6a1b88c5 | ||
|
|
1a7519becd | ||
|
|
a534b1b70b | ||
|
|
8fdd21f8a2 | ||
|
|
c561330bd0 | ||
|
|
64c62eb394 | ||
|
|
0d3cd69a0f | ||
|
|
81975b72e4 | ||
|
|
1b21471845 | ||
|
|
15f207ffc6 | ||
|
|
93aa06703b | ||
|
|
8fdd25f569 | ||
|
|
00b5c208ec | ||
|
|
c81bfcf51d | ||
|
|
942a74c86c | ||
|
|
1f95f0231d | ||
|
|
ae0e9d0a08 | ||
|
|
6a91bc73eb | ||
|
|
e15c988bf4 | ||
|
|
f36a30411d | ||
|
|
5d5e4fac50 | ||
|
|
e9027472f4 | ||
|
|
e0eb343ce0 | ||
|
|
8d223177cd | ||
|
|
f9ab79f0c2 | ||
|
|
b68393ab01 | ||
|
|
12ace6f45a | ||
|
|
9a42b463a3 |
@@ -1,17 +1,7 @@
|
||||
# Project Conventions
|
||||
|
||||
The standing working rules of this project. Formerly the
|
||||
project `CLAUDE.md`; moved here so that Claude Code subagents
|
||||
do not inherit it into their context (blind-reading agents
|
||||
must not see it). A main session working on this project
|
||||
reads this file before touching the pipeline, the data, or
|
||||
the documents.
|
||||
|
||||
## Analysis pipeline
|
||||
|
||||
The pipeline has run to completion; these conventions govern
|
||||
any rerun or extension.
|
||||
|
||||
- LLM analysis runs via Python scripts calling the Anthropic
|
||||
Messages API, Batch API where possible. Steps 1 and 3 run
|
||||
on `claude-sonnet-4-6` with `temperature=0` and thinking
|
||||
@@ -20,13 +10,13 @@ any rerun or extension.
|
||||
variance by the majority vote, step 5 by consolidating the
|
||||
three readings.
|
||||
- Prompt definition files live in
|
||||
`prompts/<step><substep>-<task>.md` (e.g. 1-tag.md,
|
||||
5a-read.md; substeps are lettered, matching the step
|
||||
numbering of the paper; no version suffix -- versions live
|
||||
in git history) and are passed verbatim as the system
|
||||
prompt. The number names a step of the research
|
||||
procedure, not the file: the deterministic vocabulary step
|
||||
(step 2) has no definition file yet holds its own number.
|
||||
`prompts/<step>-<substep>-<task>.md` (e.g. 01-tag.md; no
|
||||
version suffix -- versions live in git history) and are
|
||||
passed verbatim as the system prompt. The number names a
|
||||
step of the research procedure, not the file: the
|
||||
deterministic vocabulary step (step 2) has no definition
|
||||
file yet holds its own number. Zero padding is for
|
||||
sorting only -- prose says "step 1", "step 3".
|
||||
- Itemwise LLM judgments (per-song coding in step 3,
|
||||
per-keyword group selection in step 4) run the same
|
||||
definition file three times, independently, over the same
|
||||
@@ -74,5 +64,5 @@ any rerun or extension.
|
||||
- `results/` holds the final tallied tables (what the paper
|
||||
cites); `runs/` holds raw audit records. The paper cites
|
||||
`results/` only.
|
||||
- Any change to a definition file or the plan is recorded in
|
||||
`docs/decision-log.md` with date and reason.
|
||||
- Any change to a definition file, the codebook, or the plan is
|
||||
recorded in `docs/decision-log.md` with date and reason.
|
||||
@@ -1,396 +0,0 @@
|
||||
Attribution 4.0 International
|
||||
|
||||
=======================================================================
|
||||
|
||||
Creative Commons Corporation ("Creative Commons") is not a law firm and
|
||||
does not provide legal services or legal advice. Distribution of
|
||||
Creative Commons public licenses does not create a lawyer-client or
|
||||
other relationship. Creative Commons makes its licenses and related
|
||||
information available on an "as-is" basis. Creative Commons gives no
|
||||
warranties regarding its licenses, any material licensed under their
|
||||
terms and conditions, or any related information. Creative Commons
|
||||
disclaims all liability for damages resulting from their use to the
|
||||
fullest extent possible.
|
||||
|
||||
Using Creative Commons Public Licenses
|
||||
|
||||
Creative Commons public licenses provide a standard set of terms and
|
||||
conditions that creators and other rights holders may use to share
|
||||
original works of authorship and other material subject to copyright
|
||||
and certain other rights specified in the public license below. The
|
||||
following considerations are for informational purposes only, are not
|
||||
exhaustive, and do not form part of our licenses.
|
||||
|
||||
Considerations for licensors: Our public licenses are
|
||||
intended for use by those authorized to give the public
|
||||
permission to use material in ways otherwise restricted by
|
||||
copyright and certain other rights. Our licenses are
|
||||
irrevocable. Licensors should read and understand the terms
|
||||
and conditions of the license they choose before applying it.
|
||||
Licensors should also secure all rights necessary before
|
||||
applying our licenses so that the public can reuse the
|
||||
material as expected. Licensors should clearly mark any
|
||||
material not subject to the license. This includes other CC-
|
||||
licensed material, or material used under an exception or
|
||||
limitation to copyright. More considerations for licensors:
|
||||
wiki.creativecommons.org/Considerations_for_licensors
|
||||
|
||||
Considerations for the public: By using one of our public
|
||||
licenses, a licensor grants the public permission to use the
|
||||
licensed material under specified terms and conditions. If
|
||||
the licensor's permission is not necessary for any reason--for
|
||||
example, because of any applicable exception or limitation to
|
||||
copyright--then that use is not regulated by the license. Our
|
||||
licenses grant only permissions under copyright and certain
|
||||
other rights that a licensor has authority to grant. Use of
|
||||
the licensed material may still be restricted for other
|
||||
reasons, including because others have copyright or other
|
||||
rights in the material. A licensor may make special requests,
|
||||
such as asking that all changes be marked or described.
|
||||
Although not required by our licenses, you are encouraged to
|
||||
respect those requests where reasonable. More considerations
|
||||
for the public:
|
||||
wiki.creativecommons.org/Considerations_for_licensees
|
||||
|
||||
=======================================================================
|
||||
|
||||
Creative Commons Attribution 4.0 International Public License
|
||||
|
||||
By exercising the Licensed Rights (defined below), You accept and agree
|
||||
to be bound by the terms and conditions of this Creative Commons
|
||||
Attribution 4.0 International Public License ("Public License"). To the
|
||||
extent this Public License may be interpreted as a contract, You are
|
||||
granted the Licensed Rights in consideration of Your acceptance of
|
||||
these terms and conditions, and the Licensor grants You such rights in
|
||||
consideration of benefits the Licensor receives from making the
|
||||
Licensed Material available under these terms and conditions.
|
||||
|
||||
|
||||
Section 1 -- Definitions.
|
||||
|
||||
a. Adapted Material means material subject to Copyright and Similar
|
||||
Rights that is derived from or based upon the Licensed Material
|
||||
and in which the Licensed Material is translated, altered,
|
||||
arranged, transformed, or otherwise modified in a manner requiring
|
||||
permission under the Copyright and Similar Rights held by the
|
||||
Licensor. For purposes of this Public License, where the Licensed
|
||||
Material is a musical work, performance, or sound recording,
|
||||
Adapted Material is always produced where the Licensed Material is
|
||||
synched in timed relation with a moving image.
|
||||
|
||||
b. Adapter's License means the license You apply to Your Copyright
|
||||
and Similar Rights in Your contributions to Adapted Material in
|
||||
accordance with the terms and conditions of this Public License.
|
||||
|
||||
c. Copyright and Similar Rights means copyright and/or similar rights
|
||||
closely related to copyright including, without limitation,
|
||||
performance, broadcast, sound recording, and Sui Generis Database
|
||||
Rights, without regard to how the rights are labeled or
|
||||
categorized. For purposes of this Public License, the rights
|
||||
specified in Section 2(b)(1)-(2) are not Copyright and Similar
|
||||
Rights.
|
||||
|
||||
d. Effective Technological Measures means those measures that, in the
|
||||
absence of proper authority, may not be circumvented under laws
|
||||
fulfilling obligations under Article 11 of the WIPO Copyright
|
||||
Treaty adopted on December 20, 1996, and/or similar international
|
||||
agreements.
|
||||
|
||||
e. Exceptions and Limitations means fair use, fair dealing, and/or
|
||||
any other exception or limitation to Copyright and Similar Rights
|
||||
that applies to Your use of the Licensed Material.
|
||||
|
||||
f. Licensed Material means the artistic or literary work, database,
|
||||
or other material to which the Licensor applied this Public
|
||||
License.
|
||||
|
||||
g. Licensed Rights means the rights granted to You subject to the
|
||||
terms and conditions of this Public License, which are limited to
|
||||
all Copyright and Similar Rights that apply to Your use of the
|
||||
Licensed Material and that the Licensor has authority to license.
|
||||
|
||||
h. Licensor means the individual(s) or entity(ies) granting rights
|
||||
under this Public License.
|
||||
|
||||
i. Share means to provide material to the public by any means or
|
||||
process that requires permission under the Licensed Rights, such
|
||||
as reproduction, public display, public performance, distribution,
|
||||
dissemination, communication, or importation, and to make material
|
||||
available to the public including in ways that members of the
|
||||
public may access the material from a place and at a time
|
||||
individually chosen by them.
|
||||
|
||||
j. Sui Generis Database Rights means rights other than copyright
|
||||
resulting from Directive 96/9/EC of the European Parliament and of
|
||||
the Council of 11 March 1996 on the legal protection of databases,
|
||||
as amended and/or succeeded, as well as other essentially
|
||||
equivalent rights anywhere in the world.
|
||||
|
||||
k. You means the individual or entity exercising the Licensed Rights
|
||||
under this Public License. Your has a corresponding meaning.
|
||||
|
||||
|
||||
Section 2 -- Scope.
|
||||
|
||||
a. License grant.
|
||||
|
||||
1. Subject to the terms and conditions of this Public License,
|
||||
the Licensor hereby grants You a worldwide, royalty-free,
|
||||
non-sublicensable, non-exclusive, irrevocable license to
|
||||
exercise the Licensed Rights in the Licensed Material to:
|
||||
|
||||
a. reproduce and Share the Licensed Material, in whole or
|
||||
in part; and
|
||||
|
||||
b. produce, reproduce, and Share Adapted Material.
|
||||
|
||||
2. Exceptions and Limitations. For the avoidance of doubt, where
|
||||
Exceptions and Limitations apply to Your use, this Public
|
||||
License does not apply, and You do not need to comply with
|
||||
its terms and conditions.
|
||||
|
||||
3. Term. The term of this Public License is specified in Section
|
||||
6(a).
|
||||
|
||||
4. Media and formats; technical modifications allowed. The
|
||||
Licensor authorizes You to exercise the Licensed Rights in
|
||||
all media and formats whether now known or hereafter created,
|
||||
and to make technical modifications necessary to do so. The
|
||||
Licensor waives and/or agrees not to assert any right or
|
||||
authority to forbid You from making technical modifications
|
||||
necessary to exercise the Licensed Rights, including
|
||||
technical modifications necessary to circumvent Effective
|
||||
Technological Measures. For purposes of this Public License,
|
||||
simply making modifications authorized by this Section 2(a)
|
||||
(4) never produces Adapted Material.
|
||||
|
||||
5. Downstream recipients.
|
||||
|
||||
a. Offer from the Licensor -- Licensed Material. Every
|
||||
recipient of the Licensed Material automatically
|
||||
receives an offer from the Licensor to exercise the
|
||||
Licensed Rights under the terms and conditions of this
|
||||
Public License.
|
||||
|
||||
b. No downstream restrictions. You may not offer or impose
|
||||
any additional or different terms or conditions on, or
|
||||
apply any Effective Technological Measures to, the
|
||||
Licensed Material if doing so restricts exercise of the
|
||||
Licensed Rights by any recipient of the Licensed
|
||||
Material.
|
||||
|
||||
6. No endorsement. Nothing in this Public License constitutes or
|
||||
may be construed as permission to assert or imply that You
|
||||
are, or that Your use of the Licensed Material is, connected
|
||||
with, or sponsored, endorsed, or granted official status by,
|
||||
the Licensor or others designated to receive attribution as
|
||||
provided in Section 3(a)(1)(A)(i).
|
||||
|
||||
b. Other rights.
|
||||
|
||||
1. Moral rights, such as the right of integrity, are not
|
||||
licensed under this Public License, nor are publicity,
|
||||
privacy, and/or other similar personality rights; however, to
|
||||
the extent possible, the Licensor waives and/or agrees not to
|
||||
assert any such rights held by the Licensor to the limited
|
||||
extent necessary to allow You to exercise the Licensed
|
||||
Rights, but not otherwise.
|
||||
|
||||
2. Patent and trademark rights are not licensed under this
|
||||
Public License.
|
||||
|
||||
3. To the extent possible, the Licensor waives any right to
|
||||
collect royalties from You for the exercise of the Licensed
|
||||
Rights, whether directly or through a collecting society
|
||||
under any voluntary or waivable statutory or compulsory
|
||||
licensing scheme. In all other cases the Licensor expressly
|
||||
reserves any right to collect such royalties.
|
||||
|
||||
|
||||
Section 3 -- License Conditions.
|
||||
|
||||
Your exercise of the Licensed Rights is expressly made subject to the
|
||||
following conditions.
|
||||
|
||||
a. Attribution.
|
||||
|
||||
1. If You Share the Licensed Material (including in modified
|
||||
form), You must:
|
||||
|
||||
a. retain the following if it is supplied by the Licensor
|
||||
with the Licensed Material:
|
||||
|
||||
i. identification of the creator(s) of the Licensed
|
||||
Material and any others designated to receive
|
||||
attribution, in any reasonable manner requested by
|
||||
the Licensor (including by pseudonym if
|
||||
designated);
|
||||
|
||||
ii. a copyright notice;
|
||||
|
||||
iii. a notice that refers to this Public License;
|
||||
|
||||
iv. a notice that refers to the disclaimer of
|
||||
warranties;
|
||||
|
||||
v. a URI or hyperlink to the Licensed Material to the
|
||||
extent reasonably practicable;
|
||||
|
||||
b. indicate if You modified the Licensed Material and
|
||||
retain an indication of any previous modifications; and
|
||||
|
||||
c. indicate the Licensed Material is licensed under this
|
||||
Public License, and include the text of, or the URI or
|
||||
hyperlink to, this Public License.
|
||||
|
||||
2. You may satisfy the conditions in Section 3(a)(1) in any
|
||||
reasonable manner based on the medium, means, and context in
|
||||
which You Share the Licensed Material. For example, it may be
|
||||
reasonable to satisfy the conditions by providing a URI or
|
||||
hyperlink to a resource that includes the required
|
||||
information.
|
||||
|
||||
3. If requested by the Licensor, You must remove any of the
|
||||
information required by Section 3(a)(1)(A) to the extent
|
||||
reasonably practicable.
|
||||
|
||||
4. If You Share Adapted Material You produce, the Adapter's
|
||||
License You apply must not prevent recipients of the Adapted
|
||||
Material from complying with this Public License.
|
||||
|
||||
|
||||
Section 4 -- Sui Generis Database Rights.
|
||||
|
||||
Where the Licensed Rights include Sui Generis Database Rights that
|
||||
apply to Your use of the Licensed Material:
|
||||
|
||||
a. for the avoidance of doubt, Section 2(a)(1) grants You the right
|
||||
to extract, reuse, reproduce, and Share all or a substantial
|
||||
portion of the contents of the database;
|
||||
|
||||
b. if You include all or a substantial portion of the database
|
||||
contents in a database in which You have Sui Generis Database
|
||||
Rights, then the database in which You have Sui Generis Database
|
||||
Rights (but not its individual contents) is Adapted Material; and
|
||||
|
||||
c. You must comply with the conditions in Section 3(a) if You Share
|
||||
all or a substantial portion of the contents of the database.
|
||||
|
||||
For the avoidance of doubt, this Section 4 supplements and does not
|
||||
replace Your obligations under this Public License where the Licensed
|
||||
Rights include other Copyright and Similar Rights.
|
||||
|
||||
|
||||
Section 5 -- Disclaimer of Warranties and Limitation of Liability.
|
||||
|
||||
a. UNLESS OTHERWISE SEPARATELY UNDERTAKEN BY THE LICENSOR, TO THE
|
||||
EXTENT POSSIBLE, THE LICENSOR OFFERS THE LICENSED MATERIAL AS-IS
|
||||
AND AS-AVAILABLE, AND MAKES NO REPRESENTATIONS OR WARRANTIES OF
|
||||
ANY KIND CONCERNING THE LICENSED MATERIAL, WHETHER EXPRESS,
|
||||
IMPLIED, STATUTORY, OR OTHER. THIS INCLUDES, WITHOUT LIMITATION,
|
||||
WARRANTIES OF TITLE, MERCHANTABILITY, FITNESS FOR A PARTICULAR
|
||||
PURPOSE, NON-INFRINGEMENT, ABSENCE OF LATENT OR OTHER DEFECTS,
|
||||
ACCURACY, OR THE PRESENCE OR ABSENCE OF ERRORS, WHETHER OR NOT
|
||||
KNOWN OR DISCOVERABLE. WHERE DISCLAIMERS OF WARRANTIES ARE NOT
|
||||
ALLOWED IN FULL OR IN PART, THIS DISCLAIMER MAY NOT APPLY TO YOU.
|
||||
|
||||
b. TO THE EXTENT POSSIBLE, IN NO EVENT WILL THE LICENSOR BE LIABLE
|
||||
TO YOU ON ANY LEGAL THEORY (INCLUDING, WITHOUT LIMITATION,
|
||||
NEGLIGENCE) OR OTHERWISE FOR ANY DIRECT, SPECIAL, INDIRECT,
|
||||
INCIDENTAL, CONSEQUENTIAL, PUNITIVE, EXEMPLARY, OR OTHER LOSSES,
|
||||
COSTS, EXPENSES, OR DAMAGES ARISING OUT OF THIS PUBLIC LICENSE OR
|
||||
USE OF THE LICENSED MATERIAL, EVEN IF THE LICENSOR HAS BEEN
|
||||
ADVISED OF THE POSSIBILITY OF SUCH LOSSES, COSTS, EXPENSES, OR
|
||||
DAMAGES. WHERE A LIMITATION OF LIABILITY IS NOT ALLOWED IN FULL OR
|
||||
IN PART, THIS LIMITATION MAY NOT APPLY TO YOU.
|
||||
|
||||
c. The disclaimer of warranties and limitation of liability provided
|
||||
above shall be interpreted in a manner that, to the extent
|
||||
possible, most closely approximates an absolute disclaimer and
|
||||
waiver of all liability.
|
||||
|
||||
|
||||
Section 6 -- Term and Termination.
|
||||
|
||||
a. This Public License applies for the term of the Copyright and
|
||||
Similar Rights licensed here. However, if You fail to comply with
|
||||
this Public License, then Your rights under this Public License
|
||||
terminate automatically.
|
||||
|
||||
b. Where Your right to use the Licensed Material has terminated under
|
||||
Section 6(a), it reinstates:
|
||||
|
||||
1. automatically as of the date the violation is cured, provided
|
||||
it is cured within 30 days of Your discovery of the
|
||||
violation; or
|
||||
|
||||
2. upon express reinstatement by the Licensor.
|
||||
|
||||
For the avoidance of doubt, this Section 6(b) does not affect any
|
||||
right the Licensor may have to seek remedies for Your violations
|
||||
of this Public License.
|
||||
|
||||
c. For the avoidance of doubt, the Licensor may also offer the
|
||||
Licensed Material under separate terms or conditions or stop
|
||||
distributing the Licensed Material at any time; however, doing so
|
||||
will not terminate this Public License.
|
||||
|
||||
d. Sections 1, 5, 6, 7, and 8 survive termination of this Public
|
||||
License.
|
||||
|
||||
|
||||
Section 7 -- Other Terms and Conditions.
|
||||
|
||||
a. The Licensor shall not be bound by any additional or different
|
||||
terms or conditions communicated by You unless expressly agreed.
|
||||
|
||||
b. Any arrangements, understandings, or agreements regarding the
|
||||
Licensed Material not stated herein are separate from and
|
||||
independent of the terms and conditions of this Public License.
|
||||
|
||||
|
||||
Section 8 -- Interpretation.
|
||||
|
||||
a. For the avoidance of doubt, this Public License does not, and
|
||||
shall not be interpreted to, reduce, limit, restrict, or impose
|
||||
conditions on any use of the Licensed Material that could lawfully
|
||||
be made without permission under this Public License.
|
||||
|
||||
b. To the extent possible, if any provision of this Public License is
|
||||
deemed unenforceable, it shall be automatically reformed to the
|
||||
minimum extent necessary to make it enforceable. If the provision
|
||||
cannot be reformed, it shall be severed from this Public License
|
||||
without affecting the enforceability of the remaining terms and
|
||||
conditions.
|
||||
|
||||
c. No term or condition of this Public License will be waived and no
|
||||
failure to comply consented to unless expressly agreed to by the
|
||||
Licensor.
|
||||
|
||||
d. Nothing in this Public License constitutes or may be interpreted
|
||||
as a limitation upon, or waiver of, any privileges and immunities
|
||||
that apply to the Licensor or You, including from the legal
|
||||
processes of any jurisdiction or authority.
|
||||
|
||||
|
||||
=======================================================================
|
||||
|
||||
Creative Commons is not a party to its public
|
||||
licenses. Notwithstanding, Creative Commons may elect to apply one of
|
||||
its public licenses to material it publishes and in those instances
|
||||
will be considered the “Licensor.” The text of the Creative Commons
|
||||
public licenses is dedicated to the public domain under the CC0 Public
|
||||
Domain Dedication. Except for the limited purpose of indicating that
|
||||
material is shared under a Creative Commons public license or as
|
||||
otherwise permitted by the Creative Commons policies published at
|
||||
creativecommons.org/policies, Creative Commons does not authorize the
|
||||
use of the trademark "Creative Commons" or any other trademark or logo
|
||||
of Creative Commons without its prior written consent including,
|
||||
without limitation, in connection with any unauthorized modifications
|
||||
to any of its public licenses or any other arrangements,
|
||||
understandings, or agreements concerning use of licensed material. For
|
||||
the avoidance of doubt, this paragraph does not form part of the
|
||||
public licenses.
|
||||
|
||||
Creative Commons may be contacted at creativecommons.org.
|
||||
|
||||
@@ -1,31 +1,40 @@
|
||||
# 流行音樂中「女性力量」語彙的挪用與污染——以 Billboard Year-End Hot 100(2016-2025)為例的內容分析
|
||||
# pop-fem-audit
|
||||
|
||||
這是研究論文《流行音樂中「女性力量」語彙的挪用與污染——以 Billboard Year-End Hot 100(2016-2025)為例的內容分析》的專案資料,包括論文本身、文件、紀錄、資料、工具程式、AI提示詞,等等。
|
||||
流行音樂中「女性力量」語彙的挪用與污染——以 Billboard Year-End
|
||||
Hot 100(2016–2025)為例的內容分析。
|
||||
|
||||
## 論文和摘要
|
||||
台灣女性學學會 2026 年會論文之研究資料與分析程式。
|
||||
|
||||
研究論文全文和摘要,請參閱 paper/ 資料夾。
|
||||
## 目錄結構
|
||||
|
||||
## 文件說明
|
||||
見 `docs/project-structure.md`。研究步驟規劃見
|
||||
`docs/research-plan.md`;方法細節見 `docs/methodology.md`;
|
||||
人工編碼手冊見 `docs/codebook.md`;決策日誌見
|
||||
`docs/decision-log.md`。
|
||||
|
||||
研究方法、記錄等文件,請參閱 docs/ 資料夾。
|
||||
## 重現方式
|
||||
|
||||
## 輔助工具程式
|
||||
1. 準備 Python 3.14+ 環境,安裝分析管線套件:
|
||||
`pip install -e tools/`。
|
||||
2. 自 `tools/.env.example` 建立 `tools/.env`,寫入
|
||||
Anthropic API 金鑰。
|
||||
3. 依 `docs/research-plan.md` 的階段順序,於 `tools/` 目錄下
|
||||
執行子命令,必要輸入以位置引數、選擇性輸入以選項給定(如
|
||||
`pop-fem-audit-tools build-db
|
||||
../data/source/yearend_hot100_2016_2025.csv
|
||||
../data/derived
|
||||
--lyrics-dir ../data/captures/lyrics
|
||||
--wikidata-csv ../data/captures/artists-wikidata.csv`)。
|
||||
LLM 步驟使用 `claude-sonnet-4-6`、temperature=0、
|
||||
thinking 關閉;輸出可逐項比對的步驟獨立執行三次,由
|
||||
程式取三票多數決定案(「三次執行+多數決」協定),
|
||||
自由生成步驟兩次執行進池。
|
||||
4. 每次執行的完整紀錄(定義檔快照、原始輸出、參數)存於
|
||||
`runs/`,可逐筆稽核。論文引用的最終資料表在 `results/`。
|
||||
|
||||
輔助工具程式,請參閱 tools/ 資料夾。
|
||||
注意:歌詞受版權保護,`data/captures/lyrics/` 不隨 repo 發布,須自行
|
||||
以 `tools/` 中的抓取程式重建。
|
||||
|
||||
## 授權
|
||||
|
||||
版權所有 © 2026 楊士青。
|
||||
|
||||
除另有註明外,本專案之內容均依「CC 姓名標示 4.0 國際」授權條款提供。
|
||||
|
||||
排除物件:
|
||||
1. 本專案引用之第三方歌詞,相應權利歸各該權利人所有;
|
||||
2. tools/ 資料夾內之工具程式,依該工具程式授權條款提供。
|
||||
|
||||
## 作者
|
||||
|
||||
楊士青<br>
|
||||
imacat@mail.imacat.idv.tw<br>
|
||||
2026/8/18<br>
|
||||
(待定)
|
||||
|
||||
+17
-63
@@ -99,8 +99,8 @@
|
||||
|
||||
## 2026-08-02
|
||||
|
||||
- **`import-lyrics` 不設為子命令,pilot 歌詞改以 `excludes/`
|
||||
私人腳本匯入**。理由:pilot 捕捉檔不隨論文發布,子命令
|
||||
- **`import-lyrics` 不設為子命令,pilot 歌詞改以私人腳本
|
||||
匯入**。理由:pilot 捕捉檔不隨論文發布,子命令
|
||||
形式會在發布的 CLI 裡留下讀者無法執行的死命令——要交待的
|
||||
是「沿用 pilot 捕捉」的事實(記於 lyrics-provenance.csv 與
|
||||
論文方法節),不是工具本身;工具移出專案,發布管線即
|
||||
@@ -178,8 +178,8 @@
|
||||
來源公開可稽核,快照乾淨、overrides 縮小;論文方法節揭露
|
||||
「捕捉前經研究者查證補完」。性別以公開自我認同為準,
|
||||
推測不確定且無佐證者列疑慮清單;查證屬資料策展而非
|
||||
分析,以 Claude Code 輔助、不走分析 API;QS 批次存
|
||||
`excludes/`(私人工作檔,不隨論文發布)。
|
||||
分析,以 Claude Code 輔助、不走分析 API;QS 批次以
|
||||
私人工作檔留存,不隨論文發布。
|
||||
|
||||
## 2026-08-04
|
||||
|
||||
@@ -227,7 +227,7 @@
|
||||
- **Markdown 檔名一律以 dash 連接**(decision-log.md、
|
||||
research-plan.md、project-structure.md 等;與 data/ 層
|
||||
CSV 檔名慣例一致),定義檔命名慣例同步改為
|
||||
`prompts/<task>-v<N>.md`(如 screen-v1.md),`excludes/`
|
||||
`prompts/<task>-v<N>.md`(如 screen-v1.md),版本庫外的
|
||||
私人工作檔一併改名;`conference_abstract.md` 改名並搬入
|
||||
`paper/`——它是本次年會實際送出的摘要,與全文同屬投稿
|
||||
血脈,不是 `docs/` 的內部工作文件。全 repo 指涉同步更新。
|
||||
@@ -583,8 +583,8 @@
|
||||
Billboard 署名 Pinkfong 為品牌(Wikidata Q55735607,型態
|
||||
brand),非演唱者;其唯一上榜曲 Baby Shark(2019#75)
|
||||
的實際演唱者為 Hope Segoine(KTVB 2019-03-06 報導、
|
||||
Songfacts、經紀簡介,出處詳
|
||||
`excludes/quickstatements/hope-segoine.md`)。藉既有的
|
||||
Songfacts、經紀簡介,出處詳私人留存的
|
||||
QuickStatements 草稿)。藉既有的
|
||||
署名正規化機制(`ArtistImporter.CANONICAL_ARTIST_NAMES`)
|
||||
指認:歌曲的署名字串維持榜單所印的 "Pinkfong",解析出
|
||||
的演出者實體為 Hope Segoine。品牌無性別可言,人有;
|
||||
@@ -637,10 +637,9 @@
|
||||
(sentence-transformers/all-mpnet-base-v2, revision
|
||||
e8c3b32e)對 `runs/02-cluster/source-keywords.txt` 的
|
||||
5,999 個關鍵字重新計算。組內一致性定義為組內成員兩兩
|
||||
餘弦相似度之平均。k=50 直接取自留存的分群結果
|
||||
(`excludes/k50/02-cluster/groups.csv`);k=30 以同參數
|
||||
重跑(確定性演算法),重算所得最大組恰為 491 詞,與
|
||||
當時粗算紀錄吻合,佐證重算與原實驗一致。數表:
|
||||
餘弦相似度之平均。k=50 直接取自私人留存的分群結果;
|
||||
k=30 以同參數重跑(確定性演算法),重算所得最大組恰為
|
||||
491 詞,與當時粗算紀錄吻合,佐證重算與原實驗一致。數表:
|
||||
|
||||
| | k=30 | k=50 | k=100 |
|
||||
|---|---|---|---|
|
||||
@@ -703,8 +702,8 @@
|
||||
力量語意即入選,women-power 群 11 碼,並產詞彙表外
|
||||
幻覺碼一筆),claude-fable-5 讀為詞彙化概念(要求女性
|
||||
標記,women-power 群 2 碼),與草稿盲選及深度閱讀輔助
|
||||
判讀同讀法;sonnet 對照執行歸檔備份於
|
||||
`excludes/experiments/`,支出留帳。claude-fable-5 不
|
||||
判讀同讀法;sonnet 對照執行歸檔另行私人備份,不入
|
||||
版本庫,支出留帳。claude-fable-5 不
|
||||
受理 temperature 與 thinking 參數(均不送出),無法釘
|
||||
temperature=0;執行間變異實測存在(run1/run2 於陽剛、
|
||||
脆弱邊緣碼分歧),由三票多數決吸收;詞彙表外輸出項
|
||||
@@ -751,9 +750,9 @@
|
||||
編碼、票數),納入重建摘要與清空範圍,供群層次查詢;
|
||||
重建命令自此帶 `--groups results/groups.csv`。
|
||||
|
||||
- **Fable 5 輔助判讀實驗總錄(非正式編碼;結果檔於
|
||||
gitignored 之 `excludes/`,本條為其版本庫內的程序
|
||||
錨點)**:2026-08-08 起以 Claude Code subagent(模型
|
||||
- **Fable 5 輔助判讀實驗總錄(非正式編碼;結果檔私人
|
||||
留存、不入版本庫,本條為其版本庫內的程序錨點)**:
|
||||
2026-08-08 起以 Claude Code subagent(模型
|
||||
Fable 5)進行七項深度閱讀實驗。共同程序:每首歌一個
|
||||
獨立會話、提示最少化且逐字統一、判讀者互不知情、不經
|
||||
三票制;定位為研究者的輔助判讀(初篩),不改動任何
|
||||
@@ -783,7 +782,7 @@
|
||||
`male-mixed-wp-fe-feminist-reading.md` 與同名 .ods)。
|
||||
此系列即論文方法節「最後編碼的結果,再由研究者與 LLM
|
||||
(Claude Code)輔助判讀」之所指;結果檔含大量歌詞引文,
|
||||
依著作權紀律留置 `excludes/`,不入版本庫。
|
||||
依著作權紀律私人留置,不入版本庫。
|
||||
|
||||
- **步驟 5:女性主義問題之質性深讀(設計定案)**:論文
|
||||
題目「挪用與污染」需要框架層的系統性證據;47 首
|
||||
@@ -899,49 +898,4 @@
|
||||
performer_gender 手工修正)、四份 results 定案表、時程
|
||||
展延一至二日與剩餘撰寫工作。仍然有效的原則(先導不
|
||||
比較、提示只定格式、歌手背景防火牆、commit 判準、
|
||||
版權規則、positionality)保留。
|
||||
|
||||
## 2026-08-17
|
||||
|
||||
- **先導研究的地位另立常設紀錄 `docs/pilot-study.md`**:論文
|
||||
交件後重讀投稿摘要,認清先導研究係由當時協作的 Claude Code
|
||||
設計並執行,研究者檢視的是研究問題與答案,未逐步檢視中間
|
||||
過程;摘要中的具體數字未經稽核,亦無歸檔可回溯。此地位
|
||||
先前僅零星散見於本日誌各條(歌詞沿用、women-power 來歷
|
||||
考據、粒度繼承、簿記容量),投稿摘要本身則只是產物,不足以
|
||||
記述過程。裁定:另立 `docs/pilot-study.md`,完整記述先導
|
||||
研究的執行方式、沿用與棄用的成果,以及它如何促成正式研究
|
||||
的可稽核設計;投稿摘要不於樹中另存副本,其內容留在 git
|
||||
歷史(`paper/abstract.md` 的前身)。
|
||||
|
||||
## 2026-08-18
|
||||
|
||||
- **工序編號改與論文正文一致**:論文正文將五個步驟的細分
|
||||
工序以字母標示(表三「步驟3a」、表四「步驟5d」),repo
|
||||
的檔名與歸檔目錄卻沿用 `05-01`、`05-02` 這種數字次步,
|
||||
兩邊對不上。裁定:改為 `1-tag`、`2-cluster`、`3a-code`、
|
||||
`4-group`、`5a-read`、`5b-consolidate`、`5c-synthesize`、
|
||||
`5d-annotate`(`prompts/` 與 `runs/` 同步,以 `git mv`
|
||||
保留歷史),補零一併取消。`runs/*/meta.json`
|
||||
內記的 `prompt_path` 不追改——它是執行當下的實況記錄;
|
||||
本日誌的既有條目同理,維持當時的名稱。`run-costs.md` 則
|
||||
相反:它的「步驟」欄是查閱歸檔的索引,故一律換為現行
|
||||
編號(`01-01-01-tag`→`1-tag`、`03-01-code` 與
|
||||
`03-code`→`3a-code`),並新增末欄「原步驟名」保留執行
|
||||
當時的名稱——索引要指得到現在的歸檔,紀錄要留得住當時
|
||||
的形狀,兩者以兩欄並存解決。已刪除的工序(步驟 2 的
|
||||
LLM 合併嘗試 `01-02-01-merge`、步驟 3 的仲裁
|
||||
`03-02-arbitration`)其歸檔已不存在,無現行編號可指,
|
||||
不另發新名,步驟欄逕標「已廢棄」,原名存於末欄。
|
||||
|
||||
- **CLAUDE.md 移為 `docs/conventions.md`**:專案 CLAUDE.md 會
|
||||
全文自動注入每一個 Claude Code subagent 的 context(2026-07-30
|
||||
實測條),步驟 6 的 883 個盲判 agent 因此都看到了工作規範。
|
||||
規範本身無研究語意(無 women-power、無假說),污染有限,但
|
||||
「防脈絡污染」的原則應貫徹到自家工具鏈:docs/ 底下的檔案
|
||||
不會自動注入,搬移後 subagent 除非主動翻閱否則不會看到,
|
||||
盲判 agent 的定義檔並明令不得查閱專案材料。代價是主會話
|
||||
也不再自動載入,須自行先讀 `docs/conventions.md`。內容
|
||||
順帶微調:註明管線已完成、規範適用於重跑;刪去已不存在
|
||||
的 codebook 一詞。進論文的數據一律走 Anthropic API(無
|
||||
檔案系統,機制上不可能讀到),此層防線不受本次搬移影響。
|
||||
版權規則)保留。
|
||||
|
||||
+23
-23
@@ -98,7 +98,7 @@
|
||||
## 步驟 3 編碼的三次執行與多數決
|
||||
|
||||
- **三次執行**:同一份定義檔、同一份輸入檔,獨立執行
|
||||
三次,三份歸檔並列(`runs/3a-code/run1`、`run2`、
|
||||
三次,三份歸檔並列(`runs/03-code/run1`、`run2`、
|
||||
`run3`),彼此無先後主從之別。
|
||||
- **多數決**:一首歌的一個標籤,三次執行中至少兩次標出
|
||||
即收入定案編碼。三票不平手,裁決規則因此無例外條款,
|
||||
@@ -125,13 +125,13 @@
|
||||
由 LLM 依編碼名的字面語意判斷。
|
||||
- **任務**:每筆輸入為一個群名加 101 個編碼的字母序
|
||||
清單,輸出為入選編碼的單層 JSON 陣列;定義檔
|
||||
`prompts/4-group.md` 只定格式,不含任何群的語意定義。
|
||||
`prompts/04-group.md` 只定格式,不含任何群的語意定義。
|
||||
- **模型**:`claude-fable-5`(步驟 1、3 為
|
||||
`claude-sonnet-4-6`)。該模型不受理 `temperature` 與
|
||||
`thinking` 參數,兩者均不送出;取樣變異由多數決吸收。
|
||||
模型裁定的理由與對照實驗見決策日誌。
|
||||
- **三次執行**:同一份定義檔、同一份輸入檔,獨立執行
|
||||
三次,歸檔並列(`runs/4-group/run1`、`run2`、`run3`)。
|
||||
三次,歸檔並列(`runs/04-group/run1`、`run2`、`run3`)。
|
||||
- **多數決**:一個(群,編碼)配對,三次執行中至少兩次
|
||||
入選即屬該群;不在 101 碼詞彙表內的輸出項無效,每筆
|
||||
丟棄印於標準錯誤。計票由確定性子命令 `tally-groups`
|
||||
@@ -146,7 +146,7 @@
|
||||
|
||||
## 步驟 5 女性主義問題之質性深讀
|
||||
|
||||
本步驟之 5a 至 5c 為**質性閱讀,非編碼**:輸出為自由
|
||||
本步驟之 5-1 至 5-3 為**質性閱讀,非編碼**:輸出為自由
|
||||
文字的問題閱讀報告,無可逐項機械比對的單位,故不適用
|
||||
三票多數決與仲裁;
|
||||
三次獨立閱讀為分析者三角檢核,逐首整合為整合而非裁決,
|
||||
@@ -155,34 +155,34 @@
|
||||
|
||||
- **對象**:定案編碼含 `women-power` 或
|
||||
`female-empowerment` 的 145 首歌。
|
||||
- **5a 逐首閱讀**:每筆輸入為一首歌的完整歌詞逐字全文,
|
||||
- **5-1 逐首閱讀**:每筆輸入為一首歌的完整歌詞逐字全文,
|
||||
不含歌名與演唱者(盲讀);定義檔
|
||||
`prompts/5a-read.md`。同一份定義檔、同一份輸入檔,
|
||||
獨立執行三次,歸檔並列(`runs/5a-read/run1`、
|
||||
`prompts/05-01-read.md`。同一份定義檔、同一份輸入檔,
|
||||
獨立執行三次,歸檔並列(`runs/05-01-read/run1`、
|
||||
`run2`、`run3`)。
|
||||
- **5b 逐首整合**:每筆輸入為該首歌的三份閱讀報告
|
||||
- **5-2 逐首整合**:每筆輸入為該首歌的三份閱讀報告
|
||||
(不含歌詞);以問題機制為單位保守合併,標收斂註記
|
||||
((3/3)、(2/3)),主清單僅列兩讀以上提出者,單讀發現
|
||||
以一行存目;定義檔 `prompts/5b-consolidate.md`,
|
||||
執行一次,歸檔 `runs/5b-consolidate/run1`。
|
||||
- **5c 樣態統整**:單筆輸入為一批整合報告;歸納問題
|
||||
以一行存目;定義檔 `prompts/05-02-consolidate.md`,
|
||||
執行一次,歸檔 `runs/05-02-consolidate/run1`。
|
||||
- **5-3 樣態統整**:單筆輸入為一批整合報告;歸納問題
|
||||
**樣態**——問題呈現與運作的重複形態,非問題分類,
|
||||
代表引句僅取自主清單;定義檔
|
||||
`prompts/5c-synthesize.md`。四種輸入範圍各執行
|
||||
`prompts/05-03-synthesize.md`。四種輸入範圍各執行
|
||||
一次:全 145 首之基底統整(歸檔
|
||||
`runs/5c-synthesize/run1`),及依 `performer_gender`
|
||||
`runs/05-03-synthesize/run1`),及依 `performer_gender`
|
||||
(演唱聲音之性別)切分之三個發話脈絡統整——男聲
|
||||
(male,歸檔 `run2`)、女聲(female,歸檔 `run3`)、
|
||||
混合(mixed,歸檔 `run4`);基底看橫貫各脈絡之樣態,
|
||||
分組看各權力脈絡下之樣態。genderfluid 與 non-binary
|
||||
共 3 首不設群——樣本數不支持歸納——僅入基底統整,
|
||||
由研究者以個案閱讀。同一輸入不重複執行:自由歸納之
|
||||
產出無機械合併可言,其變異由 5a 三讀、5b 整合與
|
||||
產出無機械合併可言,其變異由 5-1 三讀、5-2 整合與
|
||||
草稿地位承接,四份草稿互為對照,由研究者終審裁決。
|
||||
- **5d 樣態標註**:以 (歌, 樣態) 對為可逐項機械比對之
|
||||
- **5-4 樣態標註**:以 (歌, 樣態) 對為可逐項機械比對之
|
||||
單位,回歸「三次執行+多數決」協定。對象為「有問題」
|
||||
的歌——三讀中至多一個「無」(多數決精神;恰兩「無」
|
||||
者其整合報告主清單必為空,與 5b 主清單規則自洽),
|
||||
者其整合報告主清單必為空,與 5-2 主清單規則自洽),
|
||||
計 111 首(男聲 12、女聲 69、混合 29、genderfluid 1)。
|
||||
樣態表為三份分組統整草稿原文:男聲 13 條(M1–M13)、
|
||||
女聲 14 條(F1–F14)、混合 16 條(X1–X16);基底 15 條
|
||||
@@ -195,17 +195,17 @@
|
||||
位置無法先驗決定),其歸屬引用維持個案地位。每筆
|
||||
輸入為一首歌之整合報告(「僅單獨提及」行於組裝時
|
||||
剝除,標註僅依主清單)與該首適用之樣態表;定義檔
|
||||
`prompts/5d-annotate.md`,獨立執行三次
|
||||
(`runs/5d-annotate/run1`~`run3`),(歌, 樣態) 對
|
||||
`prompts/05-04-annotate.md`,獨立執行三次
|
||||
(`runs/05-04-annotate/run1`~`run3`),(歌, 樣態) 對
|
||||
得兩票以上者定案。
|
||||
- **模型**:`claude-fable-5`(與先導深讀同儀器;
|
||||
`temperature` 與 `thinking` 參數不適用,均不送出)。
|
||||
- **輸入組裝**:確定性行內腳本。5a:145 首依歌曲 ID
|
||||
升序,`content` 為歌詞逐字全文;5b:每筆
|
||||
- **輸入組裝**:確定性行內腳本。5-1:145 首依歌曲 ID
|
||||
升序,`content` 為歌詞逐字全文;5-2:每筆
|
||||
`{"reports": [run1 輸出, run2 輸出, run3 輸出]}`;
|
||||
5c:單筆以 `song-<ID>` 為鍵、整合報告為值之 JSON
|
||||
5-3:單筆以 `song-<ID>` 為鍵、整合報告為值之 JSON
|
||||
物件,鍵集合為該次統整之範圍(基底為全 145 首,
|
||||
分組依工作庫 `performer_gender` 切分);5d:每筆
|
||||
分組依工作庫 `performer_gender` 切分);5-4:每筆
|
||||
`{"report": 主清單, "patterns": [{"id", "name",
|
||||
"description"}]}`,樣態條目自分組統整草稿機械切出,
|
||||
代表引句不隨附——引句出自特定歌曲,判該曲時形同
|
||||
@@ -263,7 +263,7 @@
|
||||
在資料中找不到對應者,即中止;校定的判準記於
|
||||
`decision-log.md`。
|
||||
- **合法碼清單**:純文字、一行一個碼,自詞彙表產出:
|
||||
`{ cat runs/2-cluster/result-keywords.txt; echo
|
||||
`{ cat runs/02-cluster/result-keywords.txt; echo
|
||||
women-power; } | sort`。
|
||||
- **定案表**:`results/codings.csv`,欄位 `Song`、
|
||||
`Artist Credit`、`Keyword`、`Quote`,一列一個標籤。歌名
|
||||
|
||||
@@ -1,11 +1,11 @@
|
||||
# LLM 輸出的契約查核
|
||||
|
||||
(2026-08-06 量測。對象為步驟 3 的三份執行歸檔
|
||||
`runs/3a-code/run1`–`run3`,共 883 首歌、44,149 筆標籤
|
||||
`runs/03-code/run1`–`run3`,共 883 首歌、44,149 筆標籤
|
||||
指派、44,146 句引述。歌詞以模型實際看到的那一份為準,即
|
||||
`tools/instance/llm-input-code.jsonl`。)
|
||||
|
||||
定義檔 `prompts/3a-code.md` 對輸出下了四條明確要求:只用
|
||||
定義檔 `prompts/03-code.md` 對輸出下了四條明確要求:只用
|
||||
給定的碼且拼寫照給、每個標出的碼恰引一行歌詞、引述逐字、
|
||||
輸出為合法 JSON 且無其他文字。本檔記錄這四條各自被遵守到
|
||||
什麼程度。
|
||||
|
||||
@@ -1,107 +0,0 @@
|
||||
# 先導研究的來歷與地位
|
||||
|
||||
(2026-08-17 認清並記錄。本檔記述正式研究之前的先導研究:
|
||||
它做了什麼、研究者檢視到哪一層、哪些成果被沿用、哪些被
|
||||
棄用,以及它如何促成正式研究的設計。散見於
|
||||
`decision-log.md` 的相關條目在文中逐一指出。)
|
||||
|
||||
## 一、先導研究是什麼
|
||||
|
||||
正式研究之前,研究者曾以 Claude Code 對 Billboard Year-End
|
||||
Hot 100(2018–2025、684 首)的歌詞做過一輪探索性分析,檢視
|
||||
「女性力量」語彙的使用狀況,並附帶分析 pussy 一詞作為女性
|
||||
代稱的修辭。2026 年 8 月投出的研討會摘要即根據該輪分析撰寫。
|
||||
|
||||
## 二、它實際的執行方式
|
||||
|
||||
**研究問題與方向由研究者提出**:女性力量語彙被父權框架取用、
|
||||
pussy 作為代稱的跨性別使用,都是研究者長期關注的問題。
|
||||
|
||||
**設計與執行由 Claude Code 進行**:分析管線、分類架構(genuine
|
||||
/peripheral/fake 三分類)、五種「假女性力量」類型、以及
|
||||
frame-aware 提示修正實驗,均由當時協作的 Claude Code 設計並
|
||||
執行。
|
||||
|
||||
**研究者檢視的是問題與答案,不是中間過程**:研究者確認研究
|
||||
問題的方向正確、答案值得追究,即據以投稿;分類類目如何產生、
|
||||
提示詞如何下、數字如何算出,並未逐步檢視。投稿摘要中的具體
|
||||
數字(如「44% 屬於假女性力量」、62 首的三分類、53 首的 pussy
|
||||
修辭分類、假率由 44% 降至 5% 以下)研究者未曾稽核,其產生
|
||||
過程亦無歸檔可回溯。
|
||||
|
||||
**當時的判斷**:投稿未上即罷;若上,正式研究由研究者自行
|
||||
設計與執行。事實上正式研究即是如此重做的。
|
||||
|
||||
## 三、被沿用的成果
|
||||
|
||||
- **歌詞捕捉檔**:先導研究蒐集的 lyrics.json(684 首,
|
||||
2018–2025)以 `excludes/` 的私人腳本匯入歌詞快取,只取
|
||||
識別欄位與歌詞本文,先導的分析欄位一概不匯入;出處記於
|
||||
`data/captures/lyrics-provenance.csv`,method 欄標
|
||||
`pilot-import`(見 `decision-log.md` 2026-07-31、08-02 條)。
|
||||
- **假說方向**:女性力量語彙的挪用與污染,成為正式研究的
|
||||
研究問題。
|
||||
- **粒度選擇**:正式研究鎖定 thematic keywords 這一粒度,
|
||||
係繼承先導研究三種粒度的比較結果(keywords 過碎、themes
|
||||
過早抽象),且於執行前鎖定以防事後擇優。
|
||||
- **`women-power` 一詞的來歷**:考據先導研究的 local agent
|
||||
存檔可知,其第一步指令含數十個範例 thematic keywords,
|
||||
其中即有 women-power——為當時協作的 Claude Code 依研究者
|
||||
長期表達的關注主動加入(研究者端播種,非明示指定);先導
|
||||
的標籤 `women-power-and-empowerment` 則是第三步強制合併
|
||||
兩個關鍵字的管線人工產物。正式研究的探針因此指向被播種的
|
||||
本詞 `women-power`,不用合併假影(見 `decision-log.md`
|
||||
2026-08-04 條)。**附帶認清:先導第一步並非零語意提示,
|
||||
此即正式研究「提示詞只定格式、不定語意」設計所矯正者。**
|
||||
- **簿記容量的教訓**:先導研究九百餘詞可以在單一回應內完成
|
||||
分組,正式研究的 5,999 個關鍵字則四種模型六次執行全部未
|
||||
通過完整分割驗證,遂改用詞向量嵌入+確定性分群(見
|
||||
`decision-log.md` 2026-08-06 條)。
|
||||
|
||||
## 四、被棄用的成果
|
||||
|
||||
以下先導研究的產物未進入正式研究,論文亦未引用:
|
||||
|
||||
- **genuine/peripheral/fake 三分類與「44% 假女性力量」**:
|
||||
構念與分母皆與正式研究不同(正式研究為 145 首女性力量群
|
||||
歌曲中 111 首有性別問題),兩者不可對讀。
|
||||
- **五種「假女性力量」類型(A–E)**:正式研究改由儀器分三個
|
||||
發話脈絡各自歸納,得 43 條問題樣態(`results/patterns.csv`)。
|
||||
- **pussy 一詞的修辭分類**:正式研究範圍收斂至語彙的挪用與
|
||||
污染,未納入。
|
||||
- **frame-aware(框架感知)提示修正法**:先導研究以框架判準
|
||||
寫進提示以提高準確率;正式研究刻意不定義編碼,因為研究
|
||||
對象正是 LLM 未受引導的自然編碼——把框架寫進提示,即無法
|
||||
再以其輸出為批判對象。兩者的設計方向相反,故未沿用。
|
||||
- **三個獨立 LLM subagent+人工仲裁的流程**:正式研究改以
|
||||
Anthropic API 逐首獨立呼叫,原因是實測證實 subagent 會繼承
|
||||
CLAUDE.md 與環境資訊,context 無法僅憑定義檔重現(見
|
||||
`decision-log.md` 2026-07-30 條)。
|
||||
|
||||
## 五、它如何促成正式研究的設計
|
||||
|
||||
先導研究的根本限制不在結論對錯,而在**不可稽核**:沒有定義檔
|
||||
快照、沒有原始輸出歸檔、沒有參數紀錄,因此任何一個數字都無法
|
||||
回溯到產生它的那一次執行。正式研究的幾項設計正是針對這一點:
|
||||
|
||||
- 所有 LLM 步驟改以 API script 執行,每次執行自我完備歸檔於
|
||||
`runs/`(定義檔快照、原始輸出、model ID 與參數、批次 ID、
|
||||
token 用量);
|
||||
- 可逐項機械比對的判斷採三次執行+多數決,並量測其穩定性
|
||||
(見 `reliability.md`);
|
||||
- 定義檔只規定任務形狀,不給主題定義、判準或範例;
|
||||
- 每一筆編碼必附歌詞引述,供逐筆查核;
|
||||
- 輸出的契約遵從另行查核(見 `output-validation.md`)。
|
||||
|
||||
換言之,正式研究對 LLM 輸出所採取的「不信任、須查核」立場,
|
||||
其第一個案例就是先導研究本身。
|
||||
|
||||
## 六、現存的紀錄
|
||||
|
||||
- 投稿時的先導研究摘要:已於 git 歷史中(`paper/abstract.md`
|
||||
的前身),樹中不另存副本——摘要只是產物,不足以記述過程,
|
||||
故另立本檔。
|
||||
- 先導研究的歌詞捕捉檔沿用事實:`data/captures/lyrics-provenance.csv`。
|
||||
- 相關決策條目:`decision-log.md` 2026-07-30(不與先導比較、
|
||||
不用 subagent)、07-31 與 08-02(歌詞沿用與私人匯入腳本)、
|
||||
08-04(women-power 來歷考據)、08-06(詞彙表改用詞向量分群)。
|
||||
+23
-48
@@ -1,11 +1,13 @@
|
||||
# 專案目錄結構
|
||||
|
||||
(2026-07-30 討論定案;2026-07-31 更新為 tools/ 子專案與
|
||||
SQLite 工作儲存架構;2026-08-17 依完成後的現況更新)
|
||||
SQLite 工作儲存架構)
|
||||
|
||||
```
|
||||
pop-fem-audit/
|
||||
├── README.md # 專案說明
|
||||
├── README.md # 專案說明、重現步驟
|
||||
├── CLAUDE.md # 極簡工作規範(subagent 會讀到,
|
||||
│ # 絕不放理論、codebook、預期結果)
|
||||
├── .gitignore # captures/lyrics/、.env、scratch
|
||||
├── data/ # 依生命週期分層(文字格式)
|
||||
│ ├── source/ # 源頭:手放後不動
|
||||
@@ -17,24 +19,17 @@ pop-fem-audit/
|
||||
│ │ └── lyrics/ # 歌詞 .txt 快取
|
||||
│ │ # (gitignored,版權)
|
||||
│ ├── manual/ # 人工著作:只由研究者手寫
|
||||
│ │ ├── coding-corrections.csv # 編碼與引述的校對表
|
||||
│ │ └── performer-gender-corrections.csv # 演唱聲音性別的
|
||||
│ │ # 手工修正
|
||||
│ │ # (黃金標準編碼等)
|
||||
│ └── derived/ # 衍生:只由 build-db 寫入
|
||||
│ ├── songs.csv # 歌曲報表(人讀;進 git)
|
||||
│ └── artists.csv # 歌手報表(人讀;進 git)
|
||||
├── prompts/ # LLM 定義檔(逐字作為 system prompt)
|
||||
│ └── <步><次步>-<task>.md # 1-tag.md、3a-code.md、
|
||||
│ # 4-group.md、5a-read.md、
|
||||
│ # 5b-consolidate.md、
|
||||
│ # 5c-synthesize.md、
|
||||
│ # 5d-annotate.md
|
||||
│ # (次步以字母標示,與論文正文
|
||||
│ # 的步驟編號一致;步內僅一個
|
||||
│ # 執行時省略次步)
|
||||
│ └── <步>-<次步>-<task>.md # 01-tag.md、03-code.md
|
||||
│ # (步內僅一個執行時省略次步)
|
||||
│ # 不帶版本號,版本即 git 歷史
|
||||
│ # (編號的所指是工序:確定性
|
||||
│ # 的步驟 2 無定義檔仍佔一號)
|
||||
│ # 的步驟 2 無定義檔仍佔一號;
|
||||
│ # 補零只為排序)
|
||||
├── tools/ # 輔助工具子專案(src-layout)
|
||||
│ ├── pyproject.toml # 發行名 pop-fem-audit-tools;
|
||||
│ │ # pip install -e tools/ 安裝
|
||||
@@ -57,9 +52,6 @@ pop-fem-audit/
|
||||
│ │ │ ├── cluster_keywords.py # pool the tagging runs'
|
||||
│ │ │ │ # keywords and cluster them
|
||||
│ │ │ │ # into the codes (step 2)
|
||||
│ │ │ ├── tally_codings.py # settle step 3 by majority
|
||||
│ │ │ ├── tally_groups.py # settle step 4 by majority
|
||||
│ │ │ ├── tally_annotations.py # settle step 5d by majority
|
||||
│ │ │ └── run_llm.py # API 執行器:一份定義檔+一份輸入
|
||||
│ │ │ # →歸檔至指定目錄(Batch API);
|
||||
│ │ │ # 多次執行的計票由獨立子命令承擔
|
||||
@@ -70,34 +62,22 @@ pop-fem-audit/
|
||||
│ └── tests/ # 單元測試(unittest)
|
||||
├── runs/ # 現行執行的完整稽核紀錄(進 git;
|
||||
│ │ # 重跑同一 run 須明示 --replace)
|
||||
│ ├── <步驟名>/ # 一步一個目錄(1-tag、3a-code、
|
||||
│ │ # 4-group、5a-read、
|
||||
│ │ # 5b-consolidate、
|
||||
│ │ # 5c-synthesize、5d-annotate)
|
||||
│ ├── <步驟名>/ # 一步一個目錄(如 03-code)
|
||||
│ │ └── run<N>/ # LLM 步驟:每個 run 一份自我
|
||||
│ │ ├── prompt.md # 完備歸檔(定義檔快照)
|
||||
│ │ ├── output.jsonl # 該次執行原始輸出
|
||||
│ │ └── meta.json # model ID、temperature、時間戳、
|
||||
│ │ # batch ID、token 用量
|
||||
│ └── 2-cluster/ # 確定性步驟:無執行變異,
|
||||
│ └── 02-cluster/ # 確定性步驟:無執行變異,
|
||||
│ # 不分 run<N> 層
|
||||
├── results/ # 論文引用的定案表 CSV(計票子命令
|
||||
│ │ # 產出;「可再生仍 commit」的例外)
|
||||
│ ├── codings.csv # 步驟 3 定案編碼
|
||||
│ ├── groups.csv # 步驟 4 定案編碼群
|
||||
│ ├── patterns.csv # 步驟 5c 定案樣態表
|
||||
│ ├── annotations.csv # 步驟 5d 定案歌×樣態
|
||||
│ └── pattern-matrix.csv # 前四者的人讀寬表
|
||||
├── results/ # 論文引用的報表 CSV(export 產出;
|
||||
│ # 「可再生仍 commit」的唯一例外)
|
||||
├── docs/
|
||||
│ ├── conventions.md # 常設工作規範(原 CLAUDE.md;
|
||||
│ │ # 移入 docs/ 使 subagent 不繼承)
|
||||
│ ├── research-plan.md # 研究步驟規劃(本檔之姊妹篇)
|
||||
│ ├── project-structure.md # 本檔
|
||||
│ ├── output-validation.md # LLM 輸出的契約查核紀錄
|
||||
│ ├── codebook.md # 人工編碼手冊(版本由 git 管理)
|
||||
│ ├── decision-log.md # 決策日誌:每次改定義檔的原因
|
||||
│ ├── run-costs.md # 每次執行的 token 用量與費用
|
||||
│ ├── reliability.md # 信度:量測方式與結果
|
||||
│ ├── pilot-study.md # 先導研究的來歷與地位
|
||||
│ └── methodology.md # 方法細節(全文方法節底稿;
|
||||
│ # 映射分析方法須在看結果前寫定)
|
||||
└── paper/
|
||||
@@ -114,15 +94,12 @@ pop-fem-audit/
|
||||
- **`prompts/` 檔名不帶版本號**:版本即 git 歷史,失敗的
|
||||
版本不保留;論文引用的單位是 `runs/` 內隨執行保存的定義檔
|
||||
快照(每個執行目錄自我完備),不需檔名可指的版本名。
|
||||
- **工作儲存的資料表**:`songs`(含 `performer_gender`=演唱
|
||||
聲音的性別)、`chart_entries`、`artists`、`song_artists`、
|
||||
`codings`(定案編碼:一歌一標籤一列,`quotes` 存該標籤所據的
|
||||
歌詞引述,多句以 `|` 相接)、`groups`(語意編碼群)、
|
||||
`patterns`(深讀樣態)、`annotations`(歌×樣態定案矩陣)。
|
||||
各定案表經 `build-db` 的 `--codings`、`--groups`、
|
||||
`--patterns`、`--annotations` 匯入,性別修正經
|
||||
`--gender-corrections` 套用,與其餘資料同一交易,儲存不會
|
||||
半建;詳見 `research-plan.md`「資料儲存與模型」。
|
||||
- **工作儲存的資料表**:`songs`、`chart_entries`、`artists`、
|
||||
`song_artists`、`codings`(定案編碼:一歌一標籤一列,`quotes`
|
||||
存該標籤所據的歌詞引述,多句以 `|` 相接)。定案表
|
||||
`results/codings.csv` 經 `build-db --codings` 匯入,與其餘資料
|
||||
同一交易,儲存不會半建;詳見 `research-plan.md`「資料儲存與
|
||||
模型」。
|
||||
- **Commit 判準**:能由「committed 輸入+程式」決定性再生者不
|
||||
commit(SQLite 工作儲存、LLM 輸入檔);源頭、捕捉、人工著作
|
||||
一律以文字 commit。「可再生仍 commit」的例外有二:
|
||||
@@ -132,8 +109,6 @@ pop-fem-audit/
|
||||
- **設定**經 pydantic-settings 統一:`.env`(gitignored,範本
|
||||
`tools/.env.example`)供應 `SQLALCHEMY_DATABASE_URL` 與
|
||||
`ANTHROPIC_API_KEY`,絕不寫入 repo。
|
||||
- **不設 CLAUDE.md**:實測證實 Claude Code subagent 會繼承專案
|
||||
CLAUDE.md 全文(原本因此只放極簡工作規則),2026-08-18 進一步
|
||||
將其移為 `docs/conventions.md`——docs/ 不會自動注入 subagent
|
||||
的 context,盲判型 agent 便不會看到工作規範;主會話動手前
|
||||
自行閱讀之。
|
||||
- **CLAUDE.md 極簡**:實測證實 Claude Code subagent 會繼承專案
|
||||
CLAUDE.md 全文,故其中只放工作流程規則,領域知識一律放
|
||||
`docs/`(subagent 不會自動讀到)。
|
||||
|
||||
@@ -1,161 +0,0 @@
|
||||
# 信度:量測方式與結果
|
||||
|
||||
(2026-08-16 量測。對象為步驟 3a 的三份執行歸檔
|
||||
`runs/3a-code/run1`–`run3`,與步驟 5d 的三份執行歸檔
|
||||
`runs/5d-annotate/run1`–`run3`;數字由原始輸出直接計算。)
|
||||
|
||||
## 一、本研究的信度是什麼
|
||||
|
||||
**信度(reliability)** 問的是:同一個量測重複做,會不會得到
|
||||
同樣的結果。它管的是**一致性**,不管對錯。一把每次都少兩公斤
|
||||
的秤,信度很好、效度很差。**效度(validity)** 問的則是:量到
|
||||
的是不是想量的東西。
|
||||
|
||||
Krippendorff 依產生資料的設計,把信度分成三型
|
||||
(Krippendorff, 2004;Hayes & Krippendorff, 2007):
|
||||
|
||||
- **穩定性(stability)**:同一位觀察者、同樣的材料,重複
|
||||
量測是否一致(test–retest,即 intra-observer)。
|
||||
- **可複製性(reproducibility)**:不同觀察者各自獨立量測
|
||||
是否一致,即一般所稱的**編碼者間信度**
|
||||
(inter-coder reliability)。Krippendorff 認為這是內容
|
||||
分析中最強、也最可行的一型,因為它排除了「這些類目只是
|
||||
某一個人特異的讀法」的疑慮。
|
||||
- **準確性(accuracy)**:與已知標準比對。
|
||||
|
||||
**本研究三次獨立執行量到的是第一型。**同一個模型、同一份
|
||||
定義檔、同一批輸入,重複三次,量到的是這個編碼者自己前後
|
||||
一不一致。第二型在本設計中**結構上不存在**:編碼者只有一位,
|
||||
不同的模型版本(Sonnet 4.6、Fable 5)也不是「不同的編碼者」,
|
||||
而是不同的儀器。第三型**未量測**:沒有黃金標準可比。
|
||||
|
||||
以工程的語言說更精確:這裏量的是**儀器的重複性
|
||||
(repeatability)**,亦即**隨機性有多大**;計量學上稱之為
|
||||
**精密度(precision)**,而**準確度(accuracy)** 未經量測。
|
||||
若儀器是確定性的,重複性無須量測;但 LLM 不是——同樣的提示、
|
||||
同樣的輸入,三次會給出不同結果,因此重複性是必須報告的儀器
|
||||
規格,而非慣例儀式。
|
||||
|
||||
這一點與 LLM 標註的近期文獻一致:同一模型重複取樣量測的是
|
||||
自我一致性(self-consistency),而重複執行後取多數決可提升
|
||||
標註穩定度(如 Prompt Stability Scoring,arXiv:2407.02039)。
|
||||
|
||||
## 二、三個常用指標
|
||||
|
||||
以「這首歌有沒有這個碼」這種是非題為例:
|
||||
|
||||
- **百分比一致率**:兩次判斷相同的格子佔全部格子的比例。
|
||||
最直觀,但會被「碰巧同意」灌水——當九成五的格子都是
|
||||
「無」,兩次隨便判也會有九成以上一致。
|
||||
- **Cohen's κ(kappa)**:把「碰巧同意」的部分扣掉之後的
|
||||
一致度,兩位編碼者用。0 表示與隨機無異,1 表示完全一致。
|
||||
慣例上 0.61–0.80 稱為 substantial、0.81 以上稱為
|
||||
almost perfect(Landis & Koch 1977 的分級)。
|
||||
- **Krippendorff's α**:可處理兩位以上編碼者、缺漏值與
|
||||
不同尺度,是內容分析文獻最常被要求的指標。慣例門檻為
|
||||
α ≥ 0.800 可作結論、0.667–0.800 只能作暫定結論
|
||||
(Krippendorff 的建議)。
|
||||
|
||||
三者裏,**百分比一致率會高估、κ 與 α 才是可比較的數字**。
|
||||
|
||||
補充一個常被誤解的方向:κ 的著名「悖論」
|
||||
(Feinstein & Cicchetti, 1990)是**類別分佈極不平衡時,
|
||||
高一致率反而算出很低的 κ**——偏斜會壓低 κ,不會抬高它。
|
||||
本研究的正例只佔 16.5%(89,183 格中約 14,700 格有碼),
|
||||
在這種偏斜下 κ 仍達 0.93,屬於保守估計,不是被大量「雙方
|
||||
都判無」灌出來的。
|
||||
|
||||
## 三、實測結果
|
||||
|
||||
### 步驟 3a(編碼:883 首 × 101 個碼 = 89,183 格,執行三次)
|
||||
|
||||
| 兩次執行 | 百分比一致率 | Cohen's κ | Jaccard |
|
||||
|---|---:|---:|---:|
|
||||
| run1 × run2 | 98.10% | 0.931 | 0.891 |
|
||||
| run1 × run3 | 98.09% | 0.931 | 0.891 |
|
||||
| run2 × run3 | 98.26% | 0.937 | 0.900 |
|
||||
|
||||
**Krippendorff's α = 0.933**(三次執行合計)。
|
||||
|
||||
三票計票的分佈:三票全同 13,500 格、兩票 1,163 格、
|
||||
僅一票 1,310 格(未達門檻而剔除)。**定案的 14,663 個編碼
|
||||
中,92.1% 是三次全數同意的**。
|
||||
|
||||
(此處由原始輸出計算,未套用 936 筆人工校對表;論文引用的
|
||||
定案數 14,664 為校對後的結果,差 1 筆。)
|
||||
|
||||
### 步驟 5d(樣態標註:111 首 × 各自適用樣態 = 3,708 格,執行三次)
|
||||
|
||||
| 兩次執行 | 百分比一致率 | Cohen's κ | Jaccard |
|
||||
|---|---:|---:|---:|
|
||||
| run1 × run2 | 97.87% | 0.933 | 0.898 |
|
||||
| run1 × run3 | 98.17% | 0.942 | 0.911 |
|
||||
| run2 × run3 | 97.87% | 0.933 | 0.898 |
|
||||
|
||||
**Krippendorff's α = 0.936**。三票全同 675 格、兩票 62 格、
|
||||
僅一票 51 格;**定案的 737 筆歸屬中,91.6% 三次全同**。
|
||||
|
||||
### 怎麼讀這些數字
|
||||
|
||||
κ 與 α 都在 0.93 上下,以慣例分級屬於 almost perfect,
|
||||
也高於 α ≥ 0.800 的門檻。用白話說:**這個編碼者重複三次,
|
||||
判斷幾乎不變;會左右搖擺的,是那一成左右的邊緣案例,而
|
||||
三票多數決正是為它們設計的**。
|
||||
|
||||
Jaccard(只看「有標到」的格子,忽略雙方都沒標的)約 0.89–0.91,
|
||||
比百分比一致率低而更誠實——因為 82% 的格子是雙方都判「無」,
|
||||
那些一致並不費力。
|
||||
|
||||
## 四、隨機性的規模與三票制的作用
|
||||
|
||||
信度數字回答的實際問題是:**這台儀器的隨機性,大到會不會
|
||||
改變結論?**
|
||||
|
||||
步驟 3a 的 89,183 格中,搖擺的格子共 2,473 格(兩票 1,163、
|
||||
一票 1,310),佔 2.8%。若只執行一次即定案,這批格子當中約
|
||||
一半會成為誤收、另一半會成為漏收。三票多數決把兩票以上者
|
||||
收入、一票者剔除,處理的正是這一批。
|
||||
|
||||
三票制並非消除隨機性,而是**把隨機性往案例原本的傾向推**。
|
||||
設某個邊緣案例的符合程度為 p,單次執行以機率 p 標出,三次
|
||||
多數決則以 p³+3p²(1−p) 標出:p=0.9 者由 0.9 提高到 0.972,
|
||||
p=0.1 者由 0.1 壓低到 0.028,而 p=0.5 者仍是 0.5——真正
|
||||
模稜兩可的案例,任何票制都救不了。
|
||||
|
||||
以此規模判斷,結論層的三條帶狀結構(女性力量與陽剛群共現、
|
||||
與脆弱群互斥、與厭女群獨立)不可能由這個量級的雜訊翻轉。
|
||||
反過來說,若一致率只有 0.6,同一組結論就不能採信——信度
|
||||
數字的用途在此,而不在滿足慣例。
|
||||
|
||||
## 五、這些數字證明了什麼、不能證明什麼
|
||||
|
||||
**能證明**:量測是穩定的,結果不是單次抽樣的偶然;
|
||||
三票多數決確實只在少數邊緣格子上發揮作用(約 3%)。
|
||||
|
||||
**不能證明**:判斷是正確的。三次共用同一個模型與同一份
|
||||
先驗,能濾掉隨機噪音,濾不掉系統性偏誤。本研究已發現三個
|
||||
三次一致的錯誤可作實例:Sonnet 4.6 穩定地將 Women Power
|
||||
讀為 Women+Power;深讀階段將〈Cowgirls〉中握韁繩者判反、
|
||||
將〈Happen To Me〉分屬兩段的引文接成同一動機。一把每次都
|
||||
量出同樣偏差的尺,重複性滿分,準確度為零。
|
||||
|
||||
**結構上沒有**:編碼者間信度。要有它,需要第二個獨立的
|
||||
觀察者——另一個模型,或研究者人工編一小批對照。本研究
|
||||
未做,列為限制。
|
||||
|
||||
## 六、計算方式與依據
|
||||
|
||||
- **分析單位**:每一個「(歌曲, 編碼)」格為一個單位,是非題
|
||||
(有標/無標)。步驟 3a 為 883 首 × 101 碼 = 89,183 格;
|
||||
步驟 5d 為各歌適用樣態數合計 3,708 格。
|
||||
- **Cohen's κ**:兩次執行的 2×2 表,κ=(p_o−p_e)/(1−p_e),
|
||||
p_e 由兩次各自的邊際比例相乘求得。
|
||||
- **Krippendorff's α(名目、三位「編碼者」、無缺漏)**:
|
||||
α=1−D_o/D_e;某單位若有 v 次標為「有」,其不一致配對數為
|
||||
v(3−v),D_o 為其總和除以總配對數,D_e 由整體「有/無」的
|
||||
邊際比例求得。
|
||||
- **門檻依據**:κ 的分級為 Landis & Koch (1977)
|
||||
(0.61–0.80 substantial、0.81–1.00 almost perfect);
|
||||
α 的門檻為 Krippendorff 的建議(≥0.800 可作結論、
|
||||
0.667–0.800 僅能作暫定結論)。
|
||||
- 數字由原始執行輸出直接計算,未套用 936 筆人工校對表。
|
||||
+12
-17
@@ -15,10 +15,10 @@
|
||||
script 執行。LLM 步驟以 Python script 呼叫 Anthropic
|
||||
Messages API(個人 Console 帳號、Batch API 五折),定義
|
||||
檔逐字作為 system prompt。可逐項機械比對的判斷(步驟 3
|
||||
編碼、步驟 4 選群、步驟 5d 樣態標註)採「同一定義檔
|
||||
編碼、步驟 4 選群、步驟 5-4 樣態標註)採「同一定義檔
|
||||
獨立執行三次+多數決」,計票由確定性子命令完成。自由
|
||||
生成(步驟 1 自由標註)兩次執行全數進池。步驟 5a 至
|
||||
5c 為質性閱讀協定:三次獨立閱讀為分析者三角檢核、
|
||||
生成(步驟 1 自由標註)兩次執行全數進池。步驟 5-1 至
|
||||
5-3 為質性閱讀協定:三次獨立閱讀為分析者三角檢核、
|
||||
逐首整合、樣態統整產出草稿,不適用投票與仲裁。詞彙表
|
||||
不經 LLM,由詞向量嵌入+確定性分群產生。驗證結果不符
|
||||
預期則修訂定義檔重跑該循環,絕不手改結果。
|
||||
@@ -60,8 +60,8 @@
|
||||
(`data/derived/`,進 git),與 SQLite 同交易語意。
|
||||
- 報表:論文引用的定案表進 `results/`——
|
||||
`codings.csv`(步驟 3 定案編碼)、`groups.csv`
|
||||
(步驟 4 定案編碼群)、`patterns.csv`(步驟 5c 定案
|
||||
樣態表)、`annotations.csv`(步驟 5d 定案歌×樣態
|
||||
(步驟 4 定案編碼群)、`patterns.csv`(步驟 5-3 定案
|
||||
樣態表)、`annotations.csv`(步驟 5-4 定案歌×樣態
|
||||
矩陣)。衍生與報表為「可再生仍 commit」的例外,理由:
|
||||
引用穩定性、審稿人零門檻、撰稿期數字變動可 diff。
|
||||
- **資料模型**:`songs`(含 lyrics、`performer_gender`——
|
||||
@@ -76,8 +76,8 @@
|
||||
**絕不進 LLM 輸入**——LLM 任務的 user message 維持
|
||||
歌詞-only 或管線中間產物-only,避免光環偏誤。
|
||||
- **Pilot 歌詞沿用(私人匯入,不進發布管線)**:先導研究
|
||||
捕捉檔(lyrics.json,684 首,2018–2025)以 `excludes/`
|
||||
的私人腳本匯入歌詞快取;讀者的重現路徑純粹是
|
||||
捕捉檔(lyrics.json,684 首,2018–2025)以私人腳本
|
||||
匯入歌詞快取;讀者的重現路徑純粹是
|
||||
`fetch-lyrics`;沿用之事實記於
|
||||
`data/captures/lyrics-provenance.csv`(進 git)。
|
||||
- **子命令**(`pop-fem-audit-tools <cmd>`):`build-db`
|
||||
@@ -105,16 +105,15 @@
|
||||
定案 `results/groups.csv`;wp/fe 與各編碼、各編碼群之
|
||||
關聯統計(BH-FDR 校正)入論文。
|
||||
5. **女性主義問題之質性深讀(步驟 5)**:對 wp∪fe 145 首
|
||||
——5a 逐首盲讀(僅歌詞全文)×3;5b 逐首整合(收斂
|
||||
註記、主清單限兩讀以上);5c 樣態統整(全體基底+
|
||||
男聲/女聲/混合三個發話脈絡分組);5d 樣態標註——
|
||||
——5-1 逐首盲讀(僅歌詞全文)×3;5-2 逐首整合(收斂
|
||||
註記、主清單限兩讀以上);5-3 樣態統整(全體基底+
|
||||
男聲/女聲/混合三個發話脈絡分組);5-4 樣態標註——
|
||||
以分組樣態表逐首標註「有問題」的 111 首,×3+多數決
|
||||
(`tally-annotations`),定案 `results/patterns.csv` 與
|
||||
`results/annotations.csv`。
|
||||
|
||||
定義檔命名 `prompts/<步><次步>-<task>.md`,次步以字母標示
|
||||
(與論文正文的步驟編號一致);編號的所指是工序而非定義檔
|
||||
(確定性的第 2 步無定義檔仍佔編號);檔名
|
||||
定義檔命名 `prompts/<步>-<次步>-<task>.md`,編號的所指是
|
||||
工序而非定義檔(確定性的第 2 步無定義檔仍佔編號);檔名
|
||||
不帶版本號——版本即 git 歷史;每次執行的定義檔快照隨
|
||||
`runs/` 自我完備,token 費用逐筆記於 `docs/run-costs.md`。
|
||||
|
||||
@@ -130,7 +129,3 @@
|
||||
- 歌詞受版權保護:完整歌詞不進 git
|
||||
(`data/captures/lyrics/` gitignored),論文與 repo 只留
|
||||
分析所引摘錄。
|
||||
- 工程支援(寫 script、style check、審稿)用公司訂閱的
|
||||
Claude Code;進論文的分析 token 由個人 API 帳號支付。
|
||||
- Positionality statement 寫入論文(53 歲、長年婦運者、
|
||||
資深工程師、離開學術圈多年、因整理榜單而起)。
|
||||
|
||||
+48
-56
@@ -10,61 +10,53 @@ $3/$15、opus-4-6 $5/$25、opus-5 與 fable-5 $10/$50)
|
||||
被 `--replace` 取代的執行以「已取代」標記,數字保留供
|
||||
總支出核算。
|
||||
|
||||
「步驟」欄的名稱於 2026-08-18 一律換為現行編號(見
|
||||
`decision-log.md` 當日條目),執行當時的名稱記於末欄
|
||||
「原步驟名」,未曾改名者留空。已刪除的工序——步驟 2 的
|
||||
LLM 合併嘗試(`01-02-01-merge`,詞彙表改採詞向量分群時
|
||||
放棄)與步驟 3 的仲裁(`03-02-arbitration`,改採三票
|
||||
多數決時刪除)——不另發新名,步驟欄標「已廢棄」,僅存
|
||||
本表供總支出核算。
|
||||
|
||||
| 日期 | 步驟 | 執行 | 模型 | 批次 ID | 耗時 | input | output | 費用 (USD) | 狀態 | 原步驟名 |
|
||||
|---|---|---|---|---|---|---:|---:|---:|---|---|
|
||||
| 2026-08-04 | 1-tag | run1 | claude-sonnet-4-6 | msgbatch_01PTACDQMr8M6ahnshbedjtB | 6 分 27 秒 | 763,318 | 338,661 | $3.68 | 已取代(浮水印清洗與防圍欄修訂後重跑) | 01-01-01-tag |
|
||||
| 2026-08-05 | 1-tag | run1 | claude-sonnet-4-6 | msgbatch_01TikJNd2pZVxzQ8SaybVthu | 4 分 57 秒 | 774,604 | 323,651 | $3.59 | 已取代(合法 JSON 修訂後重跑) | 01-01-01-tag |
|
||||
| 2026-08-05 | 1-tag | run1 | claude-sonnet-4-6 | msgbatch_01JFBCNqnu1cwXyqmEKLHQYF | 4 分 30 秒 | 790,370 | 328,227 | $3.65 | 已取代(song-288 平台失敗,整批重跑驗證) | 01-01-01-tag |
|
||||
| 2026-08-05 | 1-tag | run1 | claude-sonnet-4-6 | msgbatch_01VSDneWuSbf8mShA32jiWrX | 6 分 15 秒 | 790,370 | 326,193 | $3.63 | 已取代(措辭修訂後全體重跑) | 01-01-01-tag |
|
||||
| 2026-08-05 | 1-tag | run1-rescue-288 | claude-sonnet-4-6 | msgbatch_019Hq6bNVXVmp4DjRZ2cgVda | 2 分 5 秒 | 1,015 | 376 | $0.01 | 已取代(措辭修訂後全體重跑,該首原生通過)| 01-01-01-tag |
|
||||
| 2026-08-05 | 1-tag | run1 | claude-sonnet-4-6 | msgbatch_01VgZ77KAPGWmuu3PnQFqZ7Q | 7 分 1 秒 | 794,913 | 326,435 | $3.64 | 現行 | 01-01-01-tag |
|
||||
| 2026-08-05 | 1-tag | run2 | claude-sonnet-4-6 | msgbatch_01TLFey3L4fimKxcebTZQGYn | 4 分 21 秒 | 794,913 | 328,324 | $3.65 | 現行 | 01-01-01-tag |
|
||||
| 2026-08-05 | 已廢棄 | run1 | claude-sonnet-4-6 | msgbatch_01BvYMFmH8zrUq9SNxWSNba7 | 9 分 14 秒 | 46,454 | 60,974 | $0.53 | 已取代(完整分割驗證不過:漏 366、重複分派 511、撞名 4) | 01-02-01-merge |
|
||||
| 2026-08-05 | 已廢棄 | run1 | claude-opus-5 | msgbatch_018TkYpdT3DsZqq2q94FQCUN | — | 0 | 0 | $0.00 | 拒收(temperature 已棄用) | 01-02-01-merge |
|
||||
| 2026-08-05 | 已廢棄 | run1 | claude-opus-4-8 | msgbatch_018Wuux4adz5mWSvzJjfgLxb | — | 0 | 0 | $0.00 | 拒收(temperature 已棄用) | 01-02-01-merge |
|
||||
| 2026-08-05 | 已廢棄 | run1 | claude-opus-4-6 | msgbatch_01Lmt2j1Txyof9CctUK7CbHA | 12 分 19 秒 | 46,454 | 54,864 | $0.80 | 已取代(圍欄違規;漏 190、發明 151、重複 11) | 01-02-01-merge |
|
||||
| 2026-08-05 | 已廢棄 | run1 | claude-opus-5 | msgbatch_012SEfebTnjU5uWN6hhfnhhh | 8 分 45 秒 | 63,368 | 64,000 | $1.92 | 已取代(64k 截斷) | 01-02-01-merge |
|
||||
| 2026-08-05 | 已廢棄 | run1 | claude-opus-5 | msgbatch_01Wi9xEoQKCy1nZK6myVNg77 | 11 分 34 秒 | 63,368 | 70,175 | $2.07 | 已取代(驗證不過:漏 59、發明 140、重複 3) | 01-02-01-merge |
|
||||
| 2026-08-05 | 已廢棄 | run1 | claude-fable-5 | msgbatch_01M15hUs8P9FDTqWvAHdc1cA | 32 分 45 秒 | 63,368 | 107,721 | $3.01 | 現行歸檔(JSON 語法毀損,驗證不過) | 01-02-01-merge |
|
||||
| 2026-08-05 | 已廢棄 | run1 | claude-fable-5 | msgbatch_012stRP28uuQDQwobm41HMLh | — | 0 | 0 | $0.00 | 拒收(thinking.type.enabled 不支援) | 01-02-01-merge |
|
||||
| 2026-08-05 | 已廢棄 | run1 | claude-fable-5 | msgbatch_01KpS7AMx1zAHTcNujgGsouJ | 26 分 28 秒 | 63,368 | 128,000 | $3.52 | 現行歸檔(effort max:128k 全耗於推理,正文空白) | 01-02-01-merge |
|
||||
| 2026-08-05 | 3a-code | run1 | claude-sonnet-4-6 | msgbatch_01L7VepTxSNz5vruvzzjuL2c | 6 分 36 秒 | 1,247,264 | 492,730 | $5.57 | 36 首輸出遭內容過濾攔阻,待修訂重跑 | 03-01-code |
|
||||
| 2026-08-05 | 3a-code | 引述減量實驗(36 首)| claude-sonnet-4-6 | msgbatch_01Hskdhi2DkudYmgZhhgFts7 | 3 分 51 秒 | 56,458 | 11,074 | $0.17 | 實驗:每碼一行引述,36 首全數通過過濾;歸檔不入 repo | 03-01-code |
|
||||
| 2026-08-05 | 3a-code | run1 | claude-sonnet-4-6 | msgbatch_01GG5Ez9KT1pPwtQaY4sW7tv | 4 分 35 秒 | 1,293,724 | 269,166 | $3.96 | 過濾零攔阻;song-168、song-590 因餘額用盡失敗,song-775 拒答 | 03-01-code |
|
||||
| 2026-08-05 | 3a-code | 101 碼樹狀探測(148 首)| claude-sonnet-4-6 | msgbatch_017jo3E5gWVks9b39iWMTqz3 | 2 小時 11 分 | 385,270 | 79,690 | $0.87 | 實驗:k=100 葉碼+women-power;零違規碼; 歸檔不入 repo | 03-01-code |
|
||||
| 2026-08-06 | 命名實驗(100 組)| — | claude-sonnet-4-6 | msgbatch_01XSi1YtWzdVyYUzYh7DQRWg | 3 分 5 秒 | 55,090 | 1,168 | $0.09 | 實驗:LLM 命名對照 medoid,未採用;歸檔不入 repo | |
|
||||
| 2026-08-06 | 命名實驗(100 組)| — | claude-fable-5 | msgbatch_01Y8SJj1h1ZuSQRErhqkvgZE | 3 分 2 秒 | 76,211 | 2,049 | $0.43 | 實驗:同上,加禁用 themes;未採用;歸檔不入 repo | |
|
||||
| 2026-08-06 | 3a-code | run1 | claude-sonnet-4-6 | msgbatch_01GS1opvurvsf62oknnQxhtx | 3 分 46 秒 | 1,625,458 | 362,759 | $5.16 | 現行(101 碼;883 首全數有效,零攔阻) | 03-01-code |
|
||||
| 2026-08-06 | 3a-code | run2 | claude-sonnet-4-6 | msgbatch_01CxnwNLWzZbRpZK7UAdpb8i | 5 分 22 秒 | 1,625,458 | 364,098 | $5.17 | 現行(101 碼;883 首全數有效,零攔阻) | 03-01-code |
|
||||
| 2026-08-06 | 已廢棄 | — | claude-sonnet-4-6 | msgbatch_019xcQXwrbwDGFc9nE5M8AjE | 4 分 0 秒 | 763,193 | 42,389 | $1.46 | 已取代(2 首遭內容過濾攔阻、13 首輸出夾帶散文;定義檔修訂後重跑) | 03-02-arbitration |
|
||||
| 2026-08-06 | 已廢棄 | — | claude-sonnet-4-6 | msgbatch_01N7bDbXRSfAVUzzaj2thKeR | 4 分 20 秒 | 781,037 | 39,315 | $1.47 | 現行(644 首全數有效,零攔阻;保留 1,481/送裁 1,699) | 03-02-arbitration |
|
||||
| 2026-08-06 | 3a-code | run3 | claude-sonnet-4-6 | msgbatch_01KnkCaGETnFJrPddrxZTYHA | 6 分 26 秒 | 1,625,458 | 363,840 | $5.17 | 現行(101 碼;883 首全數有效,零攔阻) | 03-code |
|
||||
| 2026-08-14 | 4-group | run1 | claude-sonnet-4-6 | msgbatch_01UPNedog6feQzJ9WVfSAxBD | 1 分 1 秒 | 3,129 | 470 | $0.01 | 已取代(僅 3 群;改納 women-power 群後重跑) | 04-group |
|
||||
| 2026-08-14 | 4-group | run1 | claude-sonnet-4-6 | msgbatch_01KntJgxdicStaMjNL12P3zi | 1 分 25 秒 | 4,170 | 558 | $0.01 | 已取代(改以 claude-fable-5 執行;vulnerable 輸出含詞彙表外碼 1 筆;歸檔備份於 excludes/experiments/) | 04-group |
|
||||
| 2026-08-14 | 4-group | run1 | claude-fable-5 | msgbatch_01Mr6goBb2Efa4YrqCprbP4U | 55 秒 | 5,553 | 2,049 | $0.08 | 現行(4 群;零違規碼;temperature 與 thinking 參數不適用於本模型,未送出) | 04-group |
|
||||
| 2026-08-14 | 4-group | run2 | claude-fable-5 | msgbatch_01C17xW3YBefThTYZ83g7KkL | 1 分 21 秒 | 5,553 | 1,891 | $0.08 | 現行(4 群;零違規碼) | 04-group |
|
||||
| 2026-08-14 | 4-group | run3 | claude-fable-5 | msgbatch_01DveEMYyjCAYe6wxpcCD87V | 2 分 9 秒 | 5,553 | 1,975 | $0.08 | 現行(4 群;零違規碼) | 04-group |
|
||||
| 2026-08-15 | 5a-read | run1 | claude-fable-5 | msgbatch_018NJejke75o7kzKyjZeeKwi | 2 分 12 秒 | 189,607 | 181,299 | $5.48 | 現行(144/145 有效;song-444 平台錯誤,單筆補送) | 05-01-read |
|
||||
| 2026-08-15 | 5a-read | run1-rescue-444 | claude-fable-5 | msgbatch_01DgygMm6iYn2qEnyqHkTMfa | 1 分 52 秒 | 1,852 | 1,557 | $0.05 | 現行(run1 之 song-444 單筆補送,成功) | 05-01-read |
|
||||
| 2026-08-15 | 5a-read | run2 | claude-fable-5 | msgbatch_011txWpWDtdkNXNiPA74ZUfQ | 15 分 25 秒 | 191,459 | 185,630 | $5.60 | 現行(145/145 有效) | 05-01-read |
|
||||
| 2026-08-15 | 5a-read | run3 | claude-fable-5 | msgbatch_01Unn7C7WCnuVoLraJRXksoG | 7 分 59 秒 | 191,459 | 190,433 | $5.72 | 現行(145/145 有效) | 05-01-read |
|
||||
| 2026-08-15 | 5b-consolidate | run1 | claude-fable-5 | msgbatch_01WPyH4pCCiieHs4yU3xtHzN | 2 分 28 秒 | 326,287 | 242,785 | $7.70 | 現行(145/145 有效) | 05-02-consolidate |
|
||||
| 2026-08-15 | 5c-synthesize | run1 | claude-fable-5 | msgbatch_01XbNQb1SFrUxhk2ZWF7epPA | 3 分 0 秒 | 103,888 | 9,982 | $0.77 | 現行(15 個樣態;研究者審定用草稿) | 05-03-synthesize |
|
||||
| 2026-08-15 | 5c-synthesize | run2 | claude-fable-5 | msgbatch_01FKqq8U6m5HLLsx7KpQES26 | 3 分 4 秒 | 13,573 | 6,883 | $0.24 | 現行(男聲群 14 首;13 個樣態) | 05-03-synthesize |
|
||||
| 2026-08-15 | 5c-synthesize | run3 | claude-fable-5 | msgbatch_017tfhiRTnaxqCp6YFyoivsu | 4 分 4 秒 | 60,727 | 8,519 | $0.52 | 現行(女聲群 98 首;14 個樣態) | 05-03-synthesize |
|
||||
| 2026-08-15 | 5c-synthesize | run4 | claude-fable-5 | msgbatch_01SNjTLiNPEba4LW2tcUAcTJ | 4 分 3 秒 | 29,958 | 9,793 | $0.39 | 現行(混合群 30 首;16 個樣態) | 05-03-synthesize |
|
||||
| 2026-08-15 | 5d-annotate | run1 | claude-fable-5 | msgbatch_01H9gXXhNbhZG6gzZtvMHxhh | 3 分 9 秒 | 815,492 | 300,901 | $11.60 | 現行(109/111 有效;song-177、song-199 遭 max_tokens 截斷,單筆補送) | 05-04-annotate |
|
||||
| 2026-08-15 | 5d-annotate | run1-rescue-177-199 | claude-fable-5 | msgbatch_01YEdroZ51b8btPfG1aqPFCD | 3 分 5 秒 | 17,802 | 11,601 | $0.38 | 現行(run1 之 2 筆補送,max_tokens 提為 16000,成功) | 05-04-annotate |
|
||||
| 2026-08-15 | 5d-annotate | — | claude-fable-5 | msgbatch_01G67STqZsHpnhedat2HRU85 | 3 分 0 秒 | 17,802 | 14,162 | $0.44 | 誤送(補送批次輪詢中斷後誤判死亡而重送;原批次自行完成並歸檔為現行,本批次取消不及、兩筆皆完成,結果棄用) | 05-04-annotate |
|
||||
| 2026-08-15 | 5d-annotate | run2 | claude-fable-5 | msgbatch_01VVJpsfidNtF66GnHQdWnGR | 9 分 16 秒 | 815,492 | 306,582 | $11.74 | 現行(111/111 有效;max_tokens 16000,零截斷) | 05-04-annotate |
|
||||
| 2026-08-15 | 5d-annotate | run3 | claude-fable-5 | msgbatch_01AsYvZd8rsTYVfUYLzWfeMK | 4 分 12 秒 | 815,492 | 298,512 | $11.54 | 現行(111/111 有效;max_tokens 16000,零截斷) | 05-04-annotate |
|
||||
| 日期 | 步驟 | 執行 | 模型 | 批次 ID | 耗時 | input | output | 費用 (USD) | 狀態 |
|
||||
|---|---|---|---|---|---|---:|---:|---:|---|
|
||||
| 2026-08-04 | 01-01-01-tag | run1 | claude-sonnet-4-6 | msgbatch_01PTACDQMr8M6ahnshbedjtB | 6 分 27 秒 | 763,318 | 338,661 | $3.68 | 已取代(浮水印清洗與防圍欄修訂後重跑) |
|
||||
| 2026-08-05 | 01-01-01-tag | run1 | claude-sonnet-4-6 | msgbatch_01TikJNd2pZVxzQ8SaybVthu | 4 分 57 秒 | 774,604 | 323,651 | $3.59 | 已取代(合法 JSON 修訂後重跑) |
|
||||
| 2026-08-05 | 01-01-01-tag | run1 | claude-sonnet-4-6 | msgbatch_01JFBCNqnu1cwXyqmEKLHQYF | 4 分 30 秒 | 790,370 | 328,227 | $3.65 | 已取代(song-288 平台失敗,整批重跑驗證) |
|
||||
| 2026-08-05 | 01-01-01-tag | run1 | claude-sonnet-4-6 | msgbatch_01VSDneWuSbf8mShA32jiWrX | 6 分 15 秒 | 790,370 | 326,193 | $3.63 | 已取代(措辭修訂後全體重跑) |
|
||||
| 2026-08-05 | 01-01-01-tag | run1-rescue-288 | claude-sonnet-4-6 | msgbatch_019Hq6bNVXVmp4DjRZ2cgVda | 2 分 5 秒 | 1,015 | 376 | $0.01 | 已取代(措辭修訂後全體重跑,該首原生通過)|
|
||||
| 2026-08-05 | 01-01-01-tag | run1 | claude-sonnet-4-6 | msgbatch_01VgZ77KAPGWmuu3PnQFqZ7Q | 7 分 1 秒 | 794,913 | 326,435 | $3.64 | 現行 |
|
||||
| 2026-08-05 | 01-01-01-tag | run2 | claude-sonnet-4-6 | msgbatch_01TLFey3L4fimKxcebTZQGYn | 4 分 21 秒 | 794,913 | 328,324 | $3.65 | 現行 |
|
||||
| 2026-08-05 | 01-02-01-merge | run1 | claude-sonnet-4-6 | msgbatch_01BvYMFmH8zrUq9SNxWSNba7 | 9 分 14 秒 | 46,454 | 60,974 | $0.53 | 已取代(完整分割驗證不過:漏 366、重複分派 511、撞名 4) |
|
||||
| 2026-08-05 | 01-02-01-merge | run1 | claude-opus-5 | msgbatch_018TkYpdT3DsZqq2q94FQCUN | — | 0 | 0 | $0.00 | 拒收(temperature 已棄用) |
|
||||
| 2026-08-05 | 01-02-01-merge | run1 | claude-opus-4-8 | msgbatch_018Wuux4adz5mWSvzJjfgLxb | — | 0 | 0 | $0.00 | 拒收(temperature 已棄用) |
|
||||
| 2026-08-05 | 01-02-01-merge | run1 | claude-opus-4-6 | msgbatch_01Lmt2j1Txyof9CctUK7CbHA | 12 分 19 秒 | 46,454 | 54,864 | $0.80 | 已取代(圍欄違規;漏 190、發明 151、重複 11) |
|
||||
| 2026-08-05 | 01-02-01-merge | run1 | claude-opus-5 | msgbatch_012SEfebTnjU5uWN6hhfnhhh | 8 分 45 秒 | 63,368 | 64,000 | $1.92 | 已取代(64k 截斷) |
|
||||
| 2026-08-05 | 01-02-01-merge | run1 | claude-opus-5 | msgbatch_01Wi9xEoQKCy1nZK6myVNg77 | 11 分 34 秒 | 63,368 | 70,175 | $2.07 | 已取代(驗證不過:漏 59、發明 140、重複 3) |
|
||||
| 2026-08-05 | 01-02-01-merge | run1 | claude-fable-5 | msgbatch_01M15hUs8P9FDTqWvAHdc1cA | 32 分 45 秒 | 63,368 | 107,721 | $3.01 | 現行歸檔(JSON 語法毀損,驗證不過) |
|
||||
| 2026-08-05 | 01-02-01-merge | run1 | claude-fable-5 | msgbatch_012stRP28uuQDQwobm41HMLh | — | 0 | 0 | $0.00 | 拒收(thinking.type.enabled 不支援) |
|
||||
| 2026-08-05 | 01-02-01-merge | run1 | claude-fable-5 | msgbatch_01KpS7AMx1zAHTcNujgGsouJ | 26 分 28 秒 | 63,368 | 128,000 | $3.52 | 現行歸檔(effort max:128k 全耗於推理,正文空白) |
|
||||
| 2026-08-05 | 03-01-code | run1 | claude-sonnet-4-6 | msgbatch_01L7VepTxSNz5vruvzzjuL2c | 6 分 36 秒 | 1,247,264 | 492,730 | $5.57 | 36 首輸出遭內容過濾攔阻,待修訂重跑 |
|
||||
| 2026-08-05 | 03-01-code | 引述減量實驗(36 首)| claude-sonnet-4-6 | msgbatch_01Hskdhi2DkudYmgZhhgFts7 | 3 分 51 秒 | 56,458 | 11,074 | $0.17 | 實驗:每碼一行引述,36 首全數通過過濾;歸檔不入 repo |
|
||||
| 2026-08-05 | 03-01-code | run1 | claude-sonnet-4-6 | msgbatch_01GG5Ez9KT1pPwtQaY4sW7tv | 4 分 35 秒 | 1,293,724 | 269,166 | $3.96 | 過濾零攔阻;song-168、song-590 因餘額用盡失敗,song-775 拒答 |
|
||||
| 2026-08-05 | 03-01-code | 101 碼樹狀探測(148 首)| claude-sonnet-4-6 | msgbatch_017jo3E5gWVks9b39iWMTqz3 | 2 小時 11 分 | 385,270 | 79,690 | $0.87 | 實驗:k=100 葉碼+women-power;零違規碼; 歸檔不入 repo |
|
||||
| 2026-08-06 | 命名實驗(100 組)| — | claude-sonnet-4-6 | msgbatch_01XSi1YtWzdVyYUzYh7DQRWg | 3 分 5 秒 | 55,090 | 1,168 | $0.09 | 實驗:LLM 命名對照 medoid,未採用;歸檔不入 repo |
|
||||
| 2026-08-06 | 命名實驗(100 組)| — | claude-fable-5 | msgbatch_01Y8SJj1h1ZuSQRErhqkvgZE | 3 分 2 秒 | 76,211 | 2,049 | $0.43 | 實驗:同上,加禁用 themes;未採用;歸檔不入 repo |
|
||||
| 2026-08-06 | 03-01-code | run1 | claude-sonnet-4-6 | msgbatch_01GS1opvurvsf62oknnQxhtx | 3 分 46 秒 | 1,625,458 | 362,759 | $5.16 | 現行(101 碼;883 首全數有效,零攔阻) |
|
||||
| 2026-08-06 | 03-01-code | run2 | claude-sonnet-4-6 | msgbatch_01CxnwNLWzZbRpZK7UAdpb8i | 5 分 22 秒 | 1,625,458 | 364,098 | $5.17 | 現行(101 碼;883 首全數有效,零攔阻) |
|
||||
| 2026-08-06 | 03-02-arbitration | — | claude-sonnet-4-6 | msgbatch_019xcQXwrbwDGFc9nE5M8AjE | 4 分 0 秒 | 763,193 | 42,389 | $1.46 | 已取代(2 首遭內容過濾攔阻、13 首輸出夾帶散文;定義檔修訂後重跑) |
|
||||
| 2026-08-06 | 03-02-arbitration | — | claude-sonnet-4-6 | msgbatch_01N7bDbXRSfAVUzzaj2thKeR | 4 分 20 秒 | 781,037 | 39,315 | $1.47 | 現行(644 首全數有效,零攔阻;保留 1,481/送裁 1,699) |
|
||||
| 2026-08-06 | 03-code | run3 | claude-sonnet-4-6 | msgbatch_01KnkCaGETnFJrPddrxZTYHA | 6 分 26 秒 | 1,625,458 | 363,840 | $5.17 | 現行(101 碼;883 首全數有效,零攔阻) |
|
||||
| 2026-08-14 | 04-group | run1 | claude-sonnet-4-6 | msgbatch_01UPNedog6feQzJ9WVfSAxBD | 1 分 1 秒 | 3,129 | 470 | $0.01 | 已取代(僅 3 群;改納 women-power 群後重跑) |
|
||||
| 2026-08-14 | 04-group | run1 | claude-sonnet-4-6 | msgbatch_01KntJgxdicStaMjNL12P3zi | 1 分 25 秒 | 4,170 | 558 | $0.01 | 已取代(改以 claude-fable-5 執行;vulnerable 輸出含詞彙表外碼 1 筆;歸檔另行私人備份,不入版本庫) |
|
||||
| 2026-08-14 | 04-group | run1 | claude-fable-5 | msgbatch_01Mr6goBb2Efa4YrqCprbP4U | 55 秒 | 5,553 | 2,049 | $0.08 | 現行(4 群;零違規碼;temperature 與 thinking 參數不適用於本模型,未送出) |
|
||||
| 2026-08-14 | 04-group | run2 | claude-fable-5 | msgbatch_01C17xW3YBefThTYZ83g7KkL | 1 分 21 秒 | 5,553 | 1,891 | $0.08 | 現行(4 群;零違規碼) |
|
||||
| 2026-08-14 | 04-group | run3 | claude-fable-5 | msgbatch_01DveEMYyjCAYe6wxpcCD87V | 2 分 9 秒 | 5,553 | 1,975 | $0.08 | 現行(4 群;零違規碼) |
|
||||
| 2026-08-15 | 05-01-read | run1 | claude-fable-5 | msgbatch_018NJejke75o7kzKyjZeeKwi | 2 分 12 秒 | 189,607 | 181,299 | $5.48 | 現行(144/145 有效;song-444 平台錯誤,單筆補送) |
|
||||
| 2026-08-15 | 05-01-read | run1-rescue-444 | claude-fable-5 | msgbatch_01DgygMm6iYn2qEnyqHkTMfa | 1 分 52 秒 | 1,852 | 1,557 | $0.05 | 現行(run1 之 song-444 單筆補送,成功) |
|
||||
| 2026-08-15 | 05-01-read | run2 | claude-fable-5 | msgbatch_011txWpWDtdkNXNiPA74ZUfQ | 15 分 25 秒 | 191,459 | 185,630 | $5.60 | 現行(145/145 有效) |
|
||||
| 2026-08-15 | 05-01-read | run3 | claude-fable-5 | msgbatch_01Unn7C7WCnuVoLraJRXksoG | 7 分 59 秒 | 191,459 | 190,433 | $5.72 | 現行(145/145 有效) |
|
||||
| 2026-08-15 | 05-02-consolidate | run1 | claude-fable-5 | msgbatch_01WPyH4pCCiieHs4yU3xtHzN | 2 分 28 秒 | 326,287 | 242,785 | $7.70 | 現行(145/145 有效) |
|
||||
| 2026-08-15 | 05-03-synthesize | run1 | claude-fable-5 | msgbatch_01XbNQb1SFrUxhk2ZWF7epPA | 3 分 0 秒 | 103,888 | 9,982 | $0.77 | 現行(15 個樣態;研究者審定用草稿) |
|
||||
| 2026-08-15 | 05-03-synthesize | run2 | claude-fable-5 | msgbatch_01FKqq8U6m5HLLsx7KpQES26 | 3 分 4 秒 | 13,573 | 6,883 | $0.24 | 現行(男聲群 14 首;13 個樣態) |
|
||||
| 2026-08-15 | 05-03-synthesize | run3 | claude-fable-5 | msgbatch_017tfhiRTnaxqCp6YFyoivsu | 4 分 4 秒 | 60,727 | 8,519 | $0.52 | 現行(女聲群 98 首;14 個樣態) |
|
||||
| 2026-08-15 | 05-03-synthesize | run4 | claude-fable-5 | msgbatch_01SNjTLiNPEba4LW2tcUAcTJ | 4 分 3 秒 | 29,958 | 9,793 | $0.39 | 現行(混合群 30 首;16 個樣態) |
|
||||
| 2026-08-15 | 05-04-annotate | run1 | claude-fable-5 | msgbatch_01H9gXXhNbhZG6gzZtvMHxhh | 3 分 9 秒 | 815,492 | 300,901 | $11.60 | 現行(109/111 有效;song-177、song-199 遭 max_tokens 截斷,單筆補送) |
|
||||
| 2026-08-15 | 05-04-annotate | run1-rescue-177-199 | claude-fable-5 | msgbatch_01YEdroZ51b8btPfG1aqPFCD | 3 分 5 秒 | 17,802 | 11,601 | $0.38 | 現行(run1 之 2 筆補送,max_tokens 提為 16000,成功) |
|
||||
| 2026-08-15 | 05-04-annotate | — | claude-fable-5 | msgbatch_01G67STqZsHpnhedat2HRU85 | 3 分 0 秒 | 17,802 | 14,162 | $0.44 | 誤送(補送批次輪詢中斷後誤判死亡而重送;原批次自行完成並歸檔為現行,本批次取消不及、兩筆皆完成,結果棄用) |
|
||||
| 2026-08-15 | 05-04-annotate | run2 | claude-fable-5 | msgbatch_01VVJpsfidNtF66GnHQdWnGR | 9 分 16 秒 | 815,492 | 306,582 | $11.74 | 現行(111/111 有效;max_tokens 16000,零截斷) |
|
||||
| 2026-08-15 | 05-04-annotate | run3 | claude-fable-5 | msgbatch_01AsYvZd8rsTYVfUYLzWfeMK | 4 分 12 秒 | 815,492 | 298,512 | $11.54 | 現行(111/111 有效;max_tokens 16000,零截斷) |
|
||||
|
||||
累計支出:$125.65。
|
||||
|
||||
Reference in New Issue
Block a user