Human Generated Data

Title

Untitled (young couple posed sitting on chair in living room)

Date

1960

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9740

Human Generated Data

Title

Untitled (young couple posed sitting on chair in living room)

People

Artist: Martin Schweig, American 20th century

Date

1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9740

Machine Generated Data

Tags

Amazon
created on 2022-01-24

Person 99.6
Human 99.6
Person 99.6
Person 99.4
Person 99.3
Person 99.2
Person 99.1
Person 95.8
Furniture 94.8
Room 94.6
Indoors 94.6
Clothing 93.8
Apparel 93.8
Interior Design 93.2
Person 89.4
Shoe 80.7
Footwear 80.7
Home Decor 80.3
Living Room 76.4
Bookcase 74.9
Shelf 72
People 67.6
Female 65.4
Person 64.7
Dress 62.7
Girl 61.8
Person 60.4
Library 60
Book 60
Kid 56.8
Child 56.8
Poster 55.9
Advertisement 55.9

Clarifai
created on 2023-10-26

people 99.7
group 99.2
adult 96.6
woman 96.6
group together 93.4
education 91.4
leader 90.3
man 89.2
five 85.4
teacher 84.8
elementary school 84.1
many 83.4
child 82.7
school 80.4
several 80.3
portrait 79.4
medical practitioner 78.4
monochrome 76.4
three 76.2
administration 73.5

Imagga
created on 2022-01-24

kin 34
people 31.2
man 28.3
men 22.3
male 22
nurse 20.2
group 20.1
happy 19.4
couple 19.2
person 18.9
adult 18.6
business 17
smiling 16.6
women 16.6
standing 15.6
businessman 15
indoors 14
home 13.6
family 13.3
happiness 12.5
walking 12.3
professional 11.9
portrait 11.6
silhouette 11.6
hospital 11.1
room 11.1
child 11
two 11
blackboard 11
team 10.7
interior 10.6
crowd 10.6
classroom 10.4
teacher 10.2
mother 10
city 10
together 9.6
education 9.5
corporate 9.4
day 9.4
lifestyle 9.4
youth 9.4
casual 9.3
communication 9.2
house 9.2
girls 9.1
human 9
daughter 8.9
looking 8.8
urban 8.7
boy 8.7
walk 8.6
smile 8.5
friends 8.4
camera 8.3
sibling 8.3
holding 8.2
indoor 8.2
father 8.2
office 8.1
new 8.1
case 8
life 7.9
work 7.8
black 7.8
full length 7.8
sitting 7.7
30s 7.7
old 7.7
senior 7.5
teamwork 7.4
parent 7.4
inside 7.4
back 7.3
occupation 7.3
playing 7.3
children 7.3
to 7.1
student 7.1
job 7.1
working 7.1

Google
created on 2022-01-24

Dress 85.4
Style 83.8
Font 78.9
Art 78.7
Shelf 78.1
Vintage clothing 76.1
Pattern 73.8
Monochrome 70.6
Room 70.6
Fashion design 69.8
Visual arts 66.9
Classic 66.7
Event 66.5
Bookcase 65.5
History 64.7
Illustration 63.6
Stock photography 63.4
Suit 62.9
Child 62.1
Monochrome photography 61.2

Microsoft
created on 2022-01-24

text 99.8
person 99.3
clothing 98.4
footwear 93
woman 84.1
standing 81.7
posing 71.7
dress 69
man 56

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Female, 77.1%
Happy 40.3%
Sad 21.2%
Calm 18.7%
Confused 8.2%
Surprised 3.8%
Disgusted 3.1%
Fear 2.8%
Angry 1.9%

AWS Rekognition

Age 48-54
Gender Male, 99.6%
Sad 74.1%
Confused 20.2%
Calm 3.4%
Surprised 0.9%
Happy 0.5%
Disgusted 0.4%
Fear 0.3%
Angry 0.2%

AWS Rekognition

Age 31-41
Gender Male, 87.4%
Happy 45.9%
Calm 36.5%
Sad 10.9%
Confused 1.9%
Angry 1.8%
Disgusted 1.1%
Fear 1.1%
Surprised 0.8%

AWS Rekognition

Age 39-47
Gender Male, 93.2%
Calm 69.7%
Happy 21.7%
Sad 2.6%
Surprised 2.6%
Confused 1.9%
Disgusted 0.8%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 41-49
Gender Male, 95.6%
Happy 58.6%
Sad 7.6%
Angry 7.5%
Calm 6.5%
Disgusted 5.8%
Confused 5.8%
Surprised 4.6%
Fear 3.6%

AWS Rekognition

Age 36-44
Gender Female, 89.8%
Happy 81.8%
Surprised 12.9%
Confused 2.8%
Angry 0.7%
Sad 0.6%
Fear 0.5%
Disgusted 0.4%
Calm 0.3%

AWS Rekognition

Age 48-54
Gender Female, 81%
Happy 97.2%
Calm 1.3%
Surprised 0.6%
Sad 0.3%
Angry 0.2%
Fear 0.2%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 33-41
Gender Male, 100%
Surprised 43.9%
Happy 24.8%
Calm 19.2%
Disgusted 4.8%
Sad 2.9%
Confused 2.5%
Angry 1.1%
Fear 0.6%

AWS Rekognition

Age 22-30
Gender Female, 51.7%
Calm 85.4%
Fear 5.3%
Surprised 3%
Happy 2.7%
Sad 1.4%
Angry 1%
Disgusted 0.7%
Confused 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 99.6%
Person 99.6%
Person 99.4%
Person 99.3%
Person 99.2%
Person 99.1%
Person 95.8%
Person 89.4%
Person 64.7%
Person 60.4%
Shoe 80.7%

Text analysis

Amazon

DIEBE