Human Generated Data

Title

Untitled (man in suit seated in wingchair flanked by two sons)
Date

1930s
People

Artist: Paul Gittings, American 1900 - 1988
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12403

Human Generated Data

Title

Untitled (man in suit seated in wingchair flanked by two sons)

People

Artist: Paul Gittings, American 1900 - 1988

Date

1930s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 99.8
Apparel 99.8
Person 98.9
Human 98.9
Person 97.9
Furniture 97.1
Chair 97.1
Person 83.1
Face 71.9
People 70.9
Coat 65.7
Overcoat 63.2
Suit 63.2
Photo 62.1
Photography 62.1
Portrait 62.1
Female 56.2
Home Decor 55.9
Table 55.2

Imagga
created on 2022-01-29

barbershop 60.1
shop 45.5
patient 44.8
person 39.9
lab coat 36.2
mercantile establishment 36.1
man 33.6
coat 32
people 28.5
male 27.7
nurse 27.4
sick person 24.9
case 24.4
place of business 24
adult 23.5
medical 22.1
indoors 22
hospital 21.3
clothing 20.5
professional 20.3
sitting 18.9
senior 18.7
doctor 17.9
health 17.4
business 16.4
happy 16.3
smiling 15.9
men 15.5
clinic 15.1
occupation 14.7
home 14.4
worker 14.3
work 14.1
businessman 14.1
30s 13.5
hairdresser 13.2
clothes 13.1
looking 12.8
garment 12.8
job 12.4
medicine 12.3
establishment 12
inside 12
portrait 11.6
family 11.6
to 11.5
room 11.1
uniform 10.7
40s 10.7
two people 10.7
colleagues 10.7
illness 10.5
office 10.4
happiness 10.2
casual 10.2
smile 10
team 9.9
working 9.7
computer 9.6
elderly 9.6
profession 9.6
women 9.5
adults 9.5
day 9.4
mature 9.3
teamwork 9.3
face 9.2
20s 9.2
old 9.1
human 9
chair 8.9
70s 8.9
50s 8.8
retired 8.7
couple 8.7
laboratory 8.7
retirement 8.6
corporate 8.6
businesspeople 8.5
two 8.5
hand 8.4
care 8.2
interior 8
together 7.9
associates 7.9
scientist 7.8
standing 7.8
table 7.8
lab 7.8
sick 7.7
mid adult 7.7
daytime 7.7
angle 7.7
teacher 7.6
talking 7.6
bed 7.6
mother 7.5
meeting 7.5
student 7.5
cheerful 7.3
indoor 7.3
lady 7.3
group 7.3
bright 7.1
building 7.1

Google
created on 2022-01-29

Chair 88.8
Hat 77.2
Vintage clothing 72.9
Monochrome photography 72.5
Monochrome 72.3
Classic 69
Room 67.8
Event 65.6
Suit 65.2
Sitting 65
Stock photography 64.8
History 60.9
Font 60.6
Photo caption 58.3
Smile 58.1
Retro style 54.9
Uniform 53.4
Art 51.6

Microsoft
created on 2022-01-29

person 94.8
text 93.3
man 90.7
old 82.4
clothing 81.4
posing 78.4
white 65.6
player 61.7

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Happy 54.1%
Calm 39.4%
Surprised 4.3%
Sad 1.1%
Confused 0.5%
Disgusted 0.3%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Male, 98.8%
Calm 59.4%
Happy 20.7%
Surprised 14.9%
Sad 2.2%
Confused 1.2%
Disgusted 0.8%
Angry 0.6%
Fear 0.3%

AWS Rekognition

Age 26-36
Gender Male, 99.7%
Calm 96.3%
Surprised 2.7%
Sad 0.3%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%
Happy 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Chair 97.1%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 89%
a vintage photo of a group of people posing for a picture 88.9%
a vintage photo of a man 88.8%

Text analysis

Amazon

ARDA
MJITYY33A2 ARDA
34766
TXH... 34766 MM-J5+6.HH
TXH...
MJITYY33A2
MM-J5+6.HH

Google

3
3 47
47