Human Generated Data

Title

Untitled (portrait of man holding baby)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17740

Human Generated Data

Title

Untitled (portrait of man holding baby)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Accessories 99.6
Tie 99.6
Accessory 99.6
Human 99
Person 99
Person 98.6
Clothing 73.7
Apparel 73.7
Furniture 69.1
Smoke 66.2
Nature 63.6
Fog 63

Imagga
created on 2022-02-26

man 34.9
person 33.5
people 25.1
male 25
sport 21.4
ball 21.2
world 20.5
adult 17.7
player 16.1
professional 14.5
mask 14.4
team 13.4
athlete 13.3
game 12.5
holding 12.4
patient 12
competition 11.9
playing 11.8
child 11.7
portrait 11.6
senior 11.2
play 11.2
equipment 11
uniform 10.9
nurse 10.9
active 10.8
happy 10.6
indoors 10.5
health 10.4
helmet 10.3
stethoscope 10.3
sitting 10.3
lifestyle 10.1
clothing 9.8
business 9.7
medical 9.7
businessman 9.7
black 9.6
couple 9.6
smiling 9.4
happiness 9.4
teamwork 9.3
dark 9.2
exercise 9.1
care 9
suit 9
fun 9
family 8.9
job 8.8
home 8.8
boy 8.7
men 8.6
case 8.4
worker 8
looking 8
football helmet 7.9
education 7.8
summer 7.7
skill 7.7
athletic 7.7
instrument 7.6
doctor 7.5
human 7.5
sick person 7.5
occupation 7.3
pose 7.2
student 7.2
body 7.2
teacher 7.2
love 7.1

Microsoft
created on 2022-02-26

text 97.3
wall 95
person 95
clothing 90.8
human face 84

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Male, 95.3%
Calm 99.8%
Sad 0.1%
Surprised 0%
Disgusted 0%
Happy 0%
Fear 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 13-21
Gender Male, 87.7%
Surprised 97.6%
Calm 1%
Fear 0.5%
Happy 0.3%
Disgusted 0.3%
Angry 0.2%
Sad 0.1%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.6%
Person 99%

Text analysis

Amazon

6.

Google

6.
6.