Human Generated Data

Title

Untitled (advertising agency, men with record and Chap-Stick ads)

Date

1951

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20031

Human Generated Data

Title

Untitled (advertising agency, men with record and Chap-Stick ads)

People

Artist: Peter James Studio, American

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Book 100
Human 99.6
Person 99.6
Person 99.4
Sitting 99.3
Meal 94.1
Food 94.1
Dish 94.1
Tie 92.3
Accessories 92.3
Accessory 92.3
Tabletop 92
Furniture 92
Table 84.8
Clothing 73
Apparel 73
Crowd 72.7
Face 70.3
Musician 66.9
Musical Instrument 66.9
Glass 64
Dining Table 63
Suit 62.1
Coat 62.1
Overcoat 62.1
Indoors 61.7
Tablecloth 60
Performer 59.8
Text 59.2
Room 55.6

Imagga
created on 2022-03-05

man 48.5
businessman 47.7
meeting 45.2
office 43.1
business 42.5
male 41.1
people 37.9
businesswoman 37.3
team 34.9
businesspeople 34.2
adult 33.1
executive 31.2
person 31.1
group 30.6
laptop 29.3
desk 28.8
professional 27.9
table 27.1
colleagues 26.2
corporate 25.8
working 24.7
happy 24.4
teamwork 24.1
sitting 24.1
computer 23.7
indoors 22.8
work 22
talking 21.9
men 21.5
together 20.2
communication 18.5
looking 18.4
home 18.3
smiling 18.1
discussing 17.7
room 17.3
suit 17.1
discussion 16.6
30s 16.4
workplace 16.2
senior 15.9
job 15.9
lifestyle 15.9
manager 15.8
coworkers 15.7
couple 15.7
40s 15.6
indoor 15.5
smile 15
mature 14.9
boardroom 14.8
20s 14.7
casual 14.4
worker 13.7
confident 13.6
portrait 13.6
mid adult 13.5
handsome 13.4
lunch 13
expression 12.8
conference 12.7
corporation 12.5
secretary 12.2
successful 11.9
women 11.9
collaboration 11.8
associates 11.8
teacher 11.7
partners 11.7
busy 11.6
document 11.4
cheerful 11.4
success 11.3
presentation 11.2
camera 11.1
employee 11.1
four people 10.9
businessmen 10.7
businessperson 10.7
conversation 10.7
color 10.6
career 10.4
paper 10.3
company 10.2
classroom 10.2
two 10.2
entrepreneur 10
clothing 9.7
employment 9.7
cooperation 9.7
formal 9.5
happiness 9.4
horizontal 9.2
modern 9.1
attractive 9.1
40 45 years 8.9
jacket 8.9
interior 8.8
leader 8.7
planning 8.7
education 8.7
day 8.6
collar 8.6
four 8.6
face 8.5
females 8.5
contemporary 8.5
drink 8.4
technology 8.2
educator 8
explaining 7.9
businesswomen 7.9
appointment 7.9
25 30 years 7.8
colleague 7.8
retirement 7.7
elderly 7.7
staff 7.7
ethnic 7.6
finance 7.6
adults 7.6
plan 7.6
friends 7.5
showing 7.5
meal 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

indoor 97.6
person 97.1
window 95.2
text 88.3
man 84.8
clothing 81.7
black and white 76.5
table 61.4
music 50.6
dining table 6.3

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 85.1%
Surprised 5.4%
Happy 3.6%
Confused 2.1%
Angry 1.8%
Disgusted 1.4%
Sad 0.6%
Fear 0.1%

AWS Rekognition

Age 54-62
Gender Male, 94.6%
Calm 55.9%
Confused 15.7%
Disgusted 13.3%
Angry 10.5%
Surprised 2.1%
Sad 1.5%
Fear 0.5%
Happy 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Book 100%
Person 99.6%
Tie 92.3%

Captions

Microsoft

a man and a woman sitting at a table 86.4%
a man and a woman sitting at a table in front of a window 75.2%
a man and woman sitting at a table in front of a window 70.7%

Text analysis

Amazon

Hold
hand
On
On hand
jo
Chap-ans
Chap
hand cream
Chapans
her
cream
ChapStick
SIN
everythin
-
1
I
SIN a jo - UM
for
EAD
won
manic
. manic
a
.
- KING
for WOOD
00000
S
I BAKE - - Sun-de
UM
3430
KODAK-
SR
BAKE
HOTEL
Sun-de
فقية
WOOD
KING
Fallena

Google

Chap
ans
On
ing
Hold
Chap ans a man's hand aren hap ans On han Chap ing Hold everythin
hap
han
everythin
man's
hand
a
aren