Human Generated Data

Title

Untitled (family portrait in living room: two women on sofa, two men standing in suits, boy on bench with dog)

Date

c. 1955

People

Artist: Paul Gittings, American 1900 - 1988

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12576

Human Generated Data

Title

Untitled (family portrait in living room: two women on sofa, two men standing in suits, boy on bench with dog)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1955

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12576

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 99.9
Apparel 99.9
Person 99.7
Human 99.7
Person 99.6
Person 99.6
Person 98.6
Person 97.9
Shorts 95.9
Person 91.2
Shoe 86.3
Footwear 86.3
Coat 83.7
Shoe 83.4
Tie 81.3
Accessories 81.3
Accessory 81.3
Female 77.2
Face 73.4
Chair 67.5
Furniture 67.5
People 66.7
Sleeve 66.2
Portrait 64.5
Photography 64.5
Photo 64.5
Shoe 64.3
Shirt 59.8
Suit 59.8
Overcoat 59.8
Person 59.4
Dress 58.9
Girl 58.8
Shoe 57.4
Leisure Activities 56.9
Kid 55.7
Child 55.7

Clarifai
created on 2023-10-28

people 99.9
group 99.5
group together 98.9
man 97.4
adult 96.7
several 96.4
woman 94.1
many 91.8
three 91.3
wear 91.2
outfit 91.2
leader 90.8
five 89
medical practitioner 88.6
child 84.7
recreation 82.8
education 82.7
facial expression 82.4
four 81.5
monochrome 80.7

Imagga
created on 2022-01-29

nurse 63.6
man 44.3
people 35.7
male 34.7
person 33.9
adult 33.2
professional 32.2
lab coat 32
coat 29.8
patient 26.5
businessman 24.7
doctor 24.4
team 24.2
business 23.1
medical 22.9
couple 21.8
happy 21.3
job 21.2
smiling 21
colleagues 20.4
worker 20
health 19.4
businesspeople 19
work 18.8
hospital 18.5
occupation 18.3
office 17.7
businesswoman 17.3
men 17.2
teamwork 16.7
group 16.1
senior 15.9
working 15.9
portrait 15.5
meeting 15.1
kin 15
medicine 15
indoors 14.9
mature 14.9
corporate 14.6
teacher 14.5
clinic 14.5
30s 14.4
smile 14.2
women 14.2
care 14
lifestyle 13.7
specialist 13.6
home 13.6
elderly 13.4
talking 13.3
desk 13.2
20s 12.8
casual 12.7
clothing 12.6
happiness 12.5
illness 12.4
uniform 12.4
groom 12.2
room 12
sitting 12
old 11.8
associates 11.8
coworkers 11.8
day 11.8
40s 11.7
film 11.6
garment 11.5
together 11.4
negative 11.1
two 11
life 11
holding 10.7
face 10.7
color 10.6
table 10.4
educator 10.3
love 10.3
bright 10
suit 9.9
mid adult 9.6
looking 9.6
four 9.6
profession 9.6
treatment 9.2
indoor 9.1
modern 9.1
attractive 9.1
cheerful 8.9
discussing 8.8
forties 8.8
computer 8.8
diagnosis 8.8
examination 8.7
lab 8.7
laboratory 8.7
test 8.7
exam 8.6
stethoscope 8.4
manager 8.4
hand 8.4
case 8.3
success 8
business people 7.9
30 35 years 7.9
black 7.8
discussion 7.8
assistant 7.8
husband 7.6
wife 7.6
career 7.6
sick person 7.5
technology 7.4
light 7.4
successful 7.3
handsome 7.1
family 7.1
interior 7.1
look 7

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

text 99.4
clothing 95.9
person 88.7
posing 87.8
footwear 84.7
man 82.1
group 60.2
ice skating 51.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 100%
Surprised 81.9%
Calm 9.9%
Happy 6.5%
Disgusted 0.4%
Confused 0.4%
Sad 0.4%
Fear 0.3%
Angry 0.2%

AWS Rekognition

Age 33-41
Gender Male, 98.8%
Happy 48%
Calm 31.6%
Sad 5.9%
Fear 4.2%
Surprised 4%
Disgusted 3.7%
Angry 1.4%
Confused 1.3%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 83.4%
Happy 9.6%
Surprised 3%
Sad 1.1%
Disgusted 0.9%
Fear 0.8%
Confused 0.8%
Angry 0.3%

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Happy 58.2%
Calm 33.1%
Surprised 3.8%
Confused 1.7%
Angry 1.2%
Sad 1.1%
Disgusted 0.6%
Fear 0.4%

AWS Rekognition

Age 26-36
Gender Male, 94.2%
Calm 69.1%
Happy 30.2%
Surprised 0.4%
Confused 0.1%
Disgusted 0.1%
Sad 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 45-53
Gender Male, 99%
Sad 97.9%
Calm 1.6%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Tie
Person 99.7%
Person 99.6%
Person 99.6%
Person 98.6%
Person 97.9%
Person 91.2%
Person 59.4%
Shoe 86.3%
Shoe 83.4%
Shoe 64.3%
Shoe 57.4%
Tie 81.3%

Categories

Text analysis

Amazon

8
L 8
L 8 8 7vd
٢Я
7vd