Human Generated Data

Title

Untitled (large family posing on couch and floor of living room)

Date

1959

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9645

Human Generated Data

Title

Untitled (large family posing on couch and floor of living room)

People

Artist: Martin Schweig, American 20th century

Date

1959

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9645

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.4
Human 99.4
Person 98.7
Person 97.8
Person 97.6
Person 97.2
Person 96.7
Person 96.7
Person 96.3
Person 96.3
Room 92.8
Indoors 92.8
Interior Design 92.2
Person 92
Person 91.4
People 87.4
Furniture 82.1
Baby 73.7
Shoe 71.4
Footwear 71.4
Clothing 71.4
Apparel 71.4
Floor 66.4
Face 66.1
Person 63.9
Person 60.7
Chair 60.2
Living Room 59.8
Home Decor 58.9
Photography 58.2
Photo 58.2
Bedroom 55.5

Clarifai
created on 2023-10-27

people 99.8
group 99.5
child 97.7
chess 97.4
education 96.9
woman 96.7
man 95.4
victory 94.9
recreation 93.1
adult 92.6
board game 92.6
war 92.5
group together 91.7
school 86.5
outfit 84.5
many 84.2
monochrome 83.3
display 81.7
queen 80.8
indoors 80.3

Imagga
created on 2022-01-23

man 34.5
people 31.8
businessman 31.8
person 29
business 27.9
blackboard 27
male 26.9
classroom 26.8
room 23.5
teacher 21.6
group 19.3
education 19
team 18.8
adult 18.1
student 17.9
work 17.3
school 16.6
class 16.4
men 15.4
board 14.9
office 14.9
teamwork 14.8
silhouette 14.1
boy 13.9
happy 13.8
success 13.7
professional 13
hand 12.9
computer 12.9
finance 12.7
teaching 12.7
communication 12.6
chart 12.4
job 12.4
sign 12
portrait 11.6
smiling 11.6
design 11.2
human 11.2
chalkboard 10.8
financial 10.7
smile 10.7
cheerful 10.6
crowd 10.6
child 10.5
couple 10.4
meeting 10.4
manager 10.2
symbol 10.1
businesswoman 10
worker 9.8
idea 9.8
college 9.6
studying 9.6
women 9.5
writing 9.4
occupation 9.2
modern 9.1
black 9
technology 8.9
negative 8.6
diagram 8.6
boss 8.6
youth 8.5
gymnasium 8.5
friends 8.4
study 8.4
presentation 8.4
family 8
looking 8
standing 7.8
art 7.8
spectator 7.8
building 7.7
party 7.7
partner 7.7
employee 7.7
graph 7.7
grunge 7.7
fun 7.5
one 7.5
film 7.5
holding 7.4
indoor 7.3
university 7.3
drawing 7.1
science 7.1
interior 7.1
working 7.1
creative 7.1
growth 7

Google
created on 2022-01-23

Black 89.6
Style 84
Black-and-white 83.9
Font 81.3
Art 79.8
Suit 77.4
Monochrome 74.3
Monochrome photography 73.3
Event 73.2
Room 69.3
Visual arts 67.6
Team 64
Crew 63.1
Pattern 62.5
Ball 58.8
History 58.7
Rectangle 57.7
Flooring 57.1
Painting 53.5
Illustration 53.3

Microsoft
created on 2022-01-23

text 98.3
clothing 89.5
person 87.9
cartoon 81.1
man 55.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Male, 97.1%
Confused 81.6%
Calm 6.4%
Surprised 5.7%
Happy 1.9%
Disgusted 1.9%
Sad 1.3%
Fear 0.7%
Angry 0.5%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Surprised 78.4%
Calm 10.2%
Confused 4.7%
Disgusted 2.1%
Happy 1.5%
Angry 1.2%
Sad 1.2%
Fear 0.6%

AWS Rekognition

Age 6-16
Gender Male, 88.3%
Calm 79%
Surprised 7.9%
Confused 5.2%
Sad 5%
Fear 0.9%
Angry 0.7%
Disgusted 0.7%
Happy 0.6%

AWS Rekognition

Age 53-61
Gender Male, 99.7%
Sad 78.3%
Confused 10.4%
Happy 6.8%
Calm 1.4%
Disgusted 1.1%
Fear 0.9%
Angry 0.8%
Surprised 0.3%

AWS Rekognition

Age 33-41
Gender Male, 99.4%
Happy 63.4%
Sad 32.3%
Confused 1.3%
Surprised 0.9%
Fear 0.7%
Angry 0.5%
Disgusted 0.4%
Calm 0.4%

AWS Rekognition

Age 26-36
Gender Male, 94.4%
Calm 47.7%
Sad 27.8%
Happy 18.8%
Confused 1.5%
Fear 1.1%
Angry 1.1%
Disgusted 1%
Surprised 1%

AWS Rekognition

Age 51-59
Gender Female, 75.6%
Happy 90.1%
Confused 3.4%
Disgusted 2.3%
Calm 1.7%
Sad 1.4%
Surprised 0.5%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Female, 82.3%
Calm 93.3%
Happy 3.6%
Surprised 1%
Sad 1%
Angry 0.4%
Confused 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 51-59
Gender Female, 95.6%
Sad 58.8%
Calm 26.2%
Confused 4.6%
Surprised 2.9%
Angry 2.1%
Disgusted 1.8%
Fear 1.8%
Happy 1.7%

AWS Rekognition

Age 4-12
Gender Male, 58.2%
Confused 37.4%
Surprised 35.6%
Fear 15.6%
Sad 6.1%
Disgusted 2.2%
Happy 1.7%
Angry 0.8%
Calm 0.7%

AWS Rekognition

Age 33-41
Gender Male, 98.7%
Calm 66.5%
Sad 23.9%
Surprised 4.6%
Angry 2.3%
Disgusted 1.2%
Confused 0.6%
Happy 0.5%
Fear 0.4%

AWS Rekognition

Age 51-59
Gender Male, 63.8%
Calm 70.6%
Happy 14.6%
Sad 4.7%
Confused 2.8%
Angry 2.1%
Disgusted 2.1%
Surprised 1.7%
Fear 1.4%

AWS Rekognition

Age 24-34
Gender Female, 98.9%
Calm 80.8%
Surprised 13.3%
Confused 3%
Sad 1.1%
Disgusted 0.7%
Happy 0.5%
Fear 0.3%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Chair
Person 99.4%
Person 98.7%
Person 97.8%
Person 97.6%
Person 97.2%
Person 96.7%
Person 96.7%
Person 96.3%
Person 96.3%
Person 92%
Person 91.4%
Person 63.9%
Person 60.7%
Shoe 71.4%
Chair 60.2%

Text analysis

Google

MJIA- -YT3RA°2- -XAGO
MJIA-
-YT3RA°2-
-XAGO