Human Generated Data

Title

Untitled (man in cowboy hat and boots seated at desk, on telephone)
Date

c. 1945
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6913

Human Generated Data

Title

Untitled (man in cowboy hat and boots seated at desk, on telephone)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 99.8
Clothing 99.8
Furniture 99.3
Human 99.2
Person 99.2
Hat 97.4
Table 95.8
Desk 95.8
Accessory 93.6
Tie 93.6
Accessories 93.6
Chair 91.5
Footwear 88
Shoe 88
Electronics 70.4
Sun Hat 63.9
Cowboy Hat 57.2
Shoe 52.1

Imagga
created on 2022-01-23

scholar 58.9
intellectual 46.2
person 42.9
piano 31.7
man 28.2
home 26.3
musical instrument 26.3
male 26.2
chair 25.7
people 25.1
sitting 23.2
indoors 22.8
keyboard instrument 22.3
upright 21.5
happy 19.4
stringed instrument 19
adult 18.8
job 18.6
work 18.2
smiling 18.1
working 17.7
education 17.3
interior 16.8
business 15.8
worker 15.7
percussion instrument 14.9
computer 14.5
lifestyle 14.4
attractive 14
portrait 13.6
room 13.2
music 13.1
cheerful 13
businesswoman 12.7
table 12.6
keyboard 12.2
couple 12.2
men 12
laptop 12
occupation 11.9
casual 11.9
student 11.8
professional 11.6
office 11.4
senior 11.2
seat 11.1
harpsichord 11.1
indoor 10.9
playing 10.9
device 10.9
furniture 10.7
happiness 10.2
machine 10.1
businessman 9.7
looking 9.6
kitchen 9.4
mature 9.3
teacher 9.3
child 9.2
inside 9.2
school 9
lady 8.9
clavier 8.9
standing 8.7
play 8.6
elderly 8.6
smile 8.5
sit 8.5
learn 8.5
two 8.5
pretty 8.4
fun 8.2
alone 8.2
confident 8.2
industrial 8.2
instrument 8.1
women 7.9
black 7.8
corporate 7.7
looking camera 7.7
industry 7.7
collar 7.7
old 7.7
electric organ 7.6
house 7.5
suit 7.5
key 7.5
leisure 7.5
one 7.5
book 7.4
technology 7.4
building 7.2
handsome 7.1
kid 7.1

Google
created on 2022-01-23

Clothing 98.7
Leg 91.4
Hat 89
Chair 84.1
Sun hat 77.5
Tie 75.8
Snapshot 74.3
Drawer 73.5
Art 71.4
Eyewear 70.9
Vintage clothing 70.1
Monochrome 70
White-collar worker 69.4
Sitting 68.8
Room 68.3
Table 67.7
Monochrome photography 66.8
Classic 66.5
Stock photography 65.1
Publication 61.9

Microsoft
created on 2022-01-23

floor 99.1
indoor 93.2
furniture 93
person 92.8
piano 79.7
text 72.8
clothing 70.9
chair 61.9
black and white 56.3

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Male, 100%
Confused 42.3%
Happy 41.9%
Surprised 5.3%
Calm 3.6%
Disgusted 3.1%
Angry 1.5%
Fear 1.2%
Sad 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Hat 97.4%
Tie 93.6%
Chair 91.5%
Shoe 88%

Captions

Microsoft

a person sitting on a bench 66.3%
a man and a woman sitting on a bench 38.9%
a person sitting in a chair 38.8%

Text analysis

Amazon

TEXAS
I
50
I I 1
RUGGET
1
ANFA RUGGET
ANFA

Google

78
tHte 78
tHte