Human Generated Data

Title

Untitled (family portrait)
Date

c. 1975, from c. 1940 original
People

Artist: Legler Studio, American active 1930s-1950s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19678

Human Generated Data

Title

Untitled (family portrait)

People

Artist: Legler Studio, American active 1930s-1950s

Date

c. 1975, from c. 1940 original

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19678

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.8
Apparel 99.8
Person 99.6
Human 99.6
Person 99.5
Person 99.4
Person 99.4
Person 99.1
Person 98.9
Person 98.6
Person 98.6
Face 98.6
Person 98.4
Shirt 96.8
Tie 95.9
Accessories 95.9
Accessory 95.9
Person 95.3
People 88
Sunglasses 86.9
Smile 78.1
Sunglasses 75.1
Sleeve 73.7
Poster 72.5
Advertisement 72.5
Portrait 71.1
Photography 71.1
Photo 71.1
Glasses 69.6
Head 68.8
Man 67.9
Suit 61.4
Coat 61.4
Overcoat 61.4
Dress Shirt 55.1

Clarifai
created on 2023-10-22

group 99.9
people 99.9
portrait 99.1
group together 98.5
adult 97.6
leader 96.9
child 96.4
man 95.8
woman 95.2
five 94.9
many 94.1
three 94.1
medical practitioner 93.5
several 92.8
four 92.3
education 91.1
son 89.2
family 86.2
actor 85.6
facial expression 84.6

Imagga
created on 2022-03-05

man 34.2
person 31
male 27.6
people 25.1
senior 21.5
business 19.4
kin 19.4
blackboard 19.2
patient 19.2
adult 18.7
teacher 17.5
businessman 16.8
old 16.7
couple 16.5
grandfather 16.4
portrait 15.5
happy 15
student 13.7
smiling 13
mature 13
office 12.8
room 12.8
case 12.8
team 12.5
elderly 12.4
home 11.9
sick person 11.8
interior 11.5
world 11.3
looking 11.2
sitting 11.2
school 10.8
smile 10.7
classroom 10.3
happiness 10.2
camera 10.2
two 10.1
aged 9.9
husband 9.9
vintage 9.9
family 9.8
retired 9.7
indoors 9.7
together 9.6
nurse 9.6
education 9.5
table 9.5
wife 9.5
desk 9.4
money 9.3
banking 9.2
financial 8.9
group 8.9
professional 8.8
women 8.7
love 8.7
retirement 8.6
work 8.6
men 8.6
casual 8.5
sign 8.3
indoor 8.2
one 8.2
currency 8.1
to 8
standing 7.8
black 7.8
child 7.7
finance 7.6
hand 7.6
symbol 7.4
retro 7.4
success 7.2
board 7.2
lifestyle 7.2
face 7.1

Google
created on 2022-03-05

Smile 95.1
Shirt 94.3
Sleeve 87.2
Standing 86.4
People 78.6
Art 77.8
T-shirt 77
Font 75.7
Event 73.3
Vintage clothing 73.1
Crew 68.2
Team 68.2
Fun 67
Monochrome 66.3
Monochrome photography 66.1
History 62.4
Visual arts 62.4
Room 60.8
Pattern 59.8
Family reunion 58.3

Microsoft
created on 2022-03-05

posing 99.9
wall 99.7
text 96
smile 91.2
old 88.1
window 83.6
man 79.8
human face 76.3
person 75.9
drawing 75.2
clothing 69.6
group 67.9
sketch 58.8
gallery 57.9
picture frame 15.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 100%
Sad 41.9%
Happy 40.9%
Surprised 4.2%
Angry 3.6%
Disgusted 3.4%
Fear 3.1%
Calm 1.7%
Confused 1.2%

AWS Rekognition

Age 22-30
Gender Male, 78.7%
Calm 98.7%
Sad 0.3%
Confused 0.3%
Happy 0.3%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 24-34
Gender Male, 99.6%
Surprised 85%
Happy 9.8%
Calm 2.9%
Disgusted 0.6%
Sad 0.5%
Fear 0.5%
Angry 0.5%
Confused 0.3%

AWS Rekognition

Age 29-39
Gender Male, 100%
Happy 92.2%
Disgusted 2%
Surprised 1.6%
Calm 1.5%
Sad 0.8%
Confused 0.7%
Angry 0.6%
Fear 0.6%

AWS Rekognition

Age 27-37
Gender Male, 59.7%
Happy 67.5%
Surprised 24.5%
Calm 3%
Disgusted 1.5%
Confused 1.4%
Fear 1%
Angry 0.6%
Sad 0.4%

AWS Rekognition

Age 45-51
Gender Male, 100%
Happy 99.4%
Surprised 0.4%
Fear 0.1%
Sad 0%
Confused 0%
Angry 0%
Calm 0%
Disgusted 0%

AWS Rekognition

Age 34-42
Gender Male, 84.3%
Calm 31.2%
Happy 25.5%
Surprised 17.3%
Sad 13.4%
Fear 4.5%
Confused 4%
Disgusted 2.2%
Angry 1.9%

AWS Rekognition

Age 25-35
Gender Female, 59.3%
Happy 99.3%
Surprised 0.6%
Calm 0%
Sad 0%
Disgusted 0%
Confused 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 21-29
Gender Male, 99.6%
Happy 64.4%
Calm 18.9%
Sad 5%
Surprised 3.9%
Angry 3.2%
Disgusted 2.9%
Fear 1%
Confused 0.6%

AWS Rekognition

Age 47-53
Gender Male, 97%
Calm 61.5%
Happy 20.8%
Surprised 15.2%
Disgusted 0.8%
Fear 0.5%
Confused 0.4%
Sad 0.4%
Angry 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Sunglasses
Poster
Person 99.6%
Person 99.5%
Person 99.4%
Person 99.4%
Person 99.1%
Person 98.9%
Person 98.6%
Person 98.6%
Person 98.4%
Person 95.3%
Tie 95.9%
Sunglasses 86.9%
Sunglasses 75.1%
Poster 72.5%

Categories

Imagga

events parties 97.1%
people portraits 2.7%

Text analysis

Amazon

101

Google

EASTMAN-NITRATE-KODAK
EASTMAN-NITRATE-KODAK