Human Generated Data

Title

Untitled (family portrait)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16612

Human Generated Data

Title

Untitled (family portrait)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16612

Machine Generated Data

Tags

Amazon
created on 2022-02-12

Person 98.8
Human 98.8
Clothing 98.7
Apparel 98.7
Person 98.2
Person 98.1
Person 97.4
Person 97.1
Suit 93
Coat 93
Overcoat 93
Tie 90.9
Accessories 90.9
Accessory 90.9
Chair 89
Furniture 89
Clinic 74.6
Indoors 74.3
Female 72.9
Room 68.5
Sleeve 67.6
Shirt 65
Dress 64.6
Sitting 62.4
Girl 60.3
Tuxedo 59.6
Lab Coat 57.3
Long Sleeve 56.9
Nurse 56.5
Footwear 55.9
Shoe 54.5

Clarifai
created on 2023-10-29

people 99.8
group 99.4
man 98.4
adult 98.1
group together 96.5
woman 96.5
medical practitioner 94.7
monochrome 91.1
three 90.6
leader 90.5
education 90.3
administration 89.1
several 88.2
actor 84.3
four 83.5
outfit 79.7
science 79.7
hospital 79.2
five 78.6
medicine 77.4

Imagga
created on 2022-02-12

person 44.9
nurse 41.4
people 31.8
man 30.2
kin 29.6
patient 28.2
male 26.4
adult 23.8
happy 23.2
portrait 20.1
senior 19.7
lifestyle 18.8
smiling 18.1
casual 17.8
elderly 16.3
case 15.9
camera 15.7
couple 15.7
men 15.5
sick person 15.2
home 15.2
indoors 14.9
mature 14.9
looking 14.4
love 13.4
room 13.3
active 12.8
professional 12.8
aged 12.7
women 12.7
retired 12.6
world 12.6
happiness 12.5
old 12.5
joy 12.5
family 12.5
holding 12.4
medical 12.4
mother 12.3
standing 12.2
child 12
sport 11.5
smile 11.4
together 11.4
human 11.2
one 11.2
health 11.1
uniform 11
grandfather 10.7
sitting 10.3
day 10.2
two 10.2
sibling 10.1
face 9.9
clothing 9.9
business 9.7
group 9.7
hospital 9.6
life 9.2
alone 9.1
exercise 9.1
pensioner 9.1
planner 9
fun 9
ball 8.9
cheerful 8.9
businessman 8.8
retirement 8.6
husband 8.6
wife 8.5
player 8.4
leisure 8.3
inside 8.3
worker 8
handsome 8
bright 7.9
boy 7.8
60s 7.8
black 7.8
color 7.8
two people 7.8
older 7.8
youth 7.7
guy 7.7
teacher 7.6
doctor 7.5
outdoors 7.5
student 7.4
joyful 7.4
lady 7.3
indoor 7.3
girls 7.3
office 7.2
job 7.1

Google
created on 2022-02-12

Microsoft
created on 2022-02-12

wall 96.3
person 92.1
drawing 89.8
text 74.9
sketch 60.3
clothing 58.8
black and white 58.2
posing 46.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Happy 97.1%
Sad 1.7%
Disgusted 0.3%
Confused 0.3%
Surprised 0.2%
Angry 0.2%
Calm 0.1%
Fear 0.1%

AWS Rekognition

Age 48-54
Gender Female, 72.2%
Sad 47.4%
Happy 41.3%
Calm 3.2%
Disgusted 2.2%
Angry 2%
Confused 1.8%
Surprised 1.1%
Fear 1%

AWS Rekognition

Age 45-53
Gender Male, 96.5%
Happy 94.1%
Calm 4.2%
Sad 0.5%
Angry 0.3%
Disgusted 0.3%
Confused 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 50-58
Gender Male, 100%
Happy 54.7%
Angry 19.2%
Surprised 9.3%
Fear 7.4%
Calm 3.8%
Sad 2.6%
Disgusted 1.9%
Confused 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Shoe
Person 98.8%
Person 98.2%
Person 98.1%
Person 97.4%
Person 97.1%
Tie 90.9%
Shoe 54.5%

Categories

Text analysis

Amazon

7.
MAGGI

Google

7.
7.