Human Generated Data

Title

Untitled (large family portrait)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17256

Human Generated Data

Title

Untitled (large family portrait)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17256

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99
Human 99
Person 98.9
Person 98.8
Person 98.8
Person 98.7
Clothing 98.1
Apparel 98.1
Person 96.5
Person 95.1
Person 94.9
Shorts 94.1
Person 88.4
Person 88.2
Person 80.1
Shoe 78.4
Footwear 78.4
People 76
Female 75.8
Suit 71.9
Overcoat 71.9
Coat 71.9
Leisure Activities 67.9
Girl 67.6
Face 66.1
Chair 62.7
Furniture 62.7
Kid 61.2
Child 61.2
Housing 61
Building 61

Clarifai
created on 2023-10-29

people 99.9
group 99.7
group together 99.5
many 98.9
adult 98.6
woman 97.7
several 96.2
man 96.1
administration 94.3
education 94.2
wear 93.9
child 91.8
leader 87.1
recreation 82.7
school 81.9
five 78.9
adolescent 78.4
portrait 78
monochrome 76.4
boy 74.4

Imagga
created on 2022-02-26

teacher 35.1
person 29.4
people 27.3
educator 24.8
male 24.8
adult 24.3
man 23.5
men 21.5
sport 20.3
active 19.6
group 19.3
professional 19.3
dancer 18.5
silhouette 18.2
couple 16.5
women 15.8
happy 15
black 15
performer 14.2
world 13.9
lifestyle 13.7
boy 13
outdoor 13
portrait 12.3
run 11.6
stage 11.4
recreation 10.7
team 10.7
entertainer 10.7
kin 10.5
together 10.5
friendship 10.3
youth 10.2
room 10.2
smiling 10.1
girls 10
exercise 10
leisure 10
ball 9.7
fun 9.7
business 9.7
businessman 9.7
body 9.6
home 9.6
play 9.5
love 9.5
friends 9.4
competition 9.1
fitness 9
dance 8.9
athlete 8.7
grass 8.7
happiness 8.6
party 8.6
two 8.5
attractive 8.4
planner 8.4
hand 8.3
action 8.3
fashion 8.3
teenager 8.2
sunset 8.1
office 8
classroom 8
art 7.8
sitting 7.7
running 7.7
joy 7.5
dark 7.5
park 7.4
child 7.2
handsome 7.1
interior 7.1
day 7.1

Google
created on 2022-02-26

Photograph 94.1
Line 82
Suit 79.9
Window 77
Snapshot 74.3
Monochrome 73.3
Font 72.9
Crew 71.7
Vintage clothing 71.5
Event 70.3
Team 69.2
Stock photography 63.5
Monochrome photography 62.7
History 62.7
Room 62.3
Sitting 59.7
Music 58.7
Illustration 57.6
Uniform 57.3
Photo caption 55.5

Microsoft
created on 2022-02-26

person 98.3
text 93
clothing 90.1
musical instrument 72.2
woman 64.2
man 58.3
posing 53.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 16-22
Gender Male, 99.9%
Happy 85.6%
Sad 10.4%
Calm 2%
Surprised 0.6%
Angry 0.5%
Disgusted 0.4%
Confused 0.3%
Fear 0.2%

AWS Rekognition

Age 45-51
Gender Male, 67.7%
Surprised 47.6%
Calm 25.8%
Sad 9.6%
Confused 7.3%
Happy 3.9%
Disgusted 2.8%
Angry 1.7%
Fear 1.4%

AWS Rekognition

Age 30-40
Gender Male, 87.8%
Calm 63.7%
Sad 30.1%
Happy 3.3%
Disgusted 1.2%
Confused 1.1%
Angry 0.4%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Sad 75.4%
Calm 12.5%
Happy 6.5%
Confused 2.1%
Fear 1.8%
Disgusted 0.7%
Angry 0.5%
Surprised 0.4%

AWS Rekognition

Age 29-39
Gender Male, 97.2%
Calm 99.5%
Surprised 0.1%
Happy 0.1%
Sad 0.1%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 25-35
Gender Male, 67%
Calm 50.5%
Happy 30.8%
Sad 13%
Confused 2.3%
Disgusted 1.3%
Surprised 0.8%
Angry 0.7%
Fear 0.6%

AWS Rekognition

Age 33-41
Gender Male, 83.3%
Calm 75.8%
Sad 9.1%
Happy 5.9%
Fear 2.5%
Angry 2.1%
Surprised 1.8%
Confused 1.8%
Disgusted 0.9%

AWS Rekognition

Age 37-45
Gender Female, 98.8%
Sad 85%
Calm 9.1%
Happy 4.5%
Surprised 0.4%
Confused 0.3%
Disgusted 0.3%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 35-43
Gender Male, 86.5%
Calm 75.7%
Happy 9.7%
Sad 5%
Confused 4.9%
Disgusted 1.6%
Angry 1.2%
Surprised 1.1%
Fear 0.9%

AWS Rekognition

Age 11-19
Gender Male, 65.8%
Calm 99.8%
Sad 0.1%
Surprised 0%
Confused 0%
Happy 0%
Disgusted 0%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 99%
Person 98.9%
Person 98.8%
Person 98.8%
Person 98.7%
Person 96.5%
Person 95.1%
Person 94.9%
Person 88.4%
Person 88.2%
Person 80.1%
Shoe 78.4%

Categories

Imagga

people portraits 99.4%

Text analysis

Amazon

12
189
KODVK-SLELA

Google

YT3FA2-XA
YT3FA2-XA