Human Generated Data

Title

Untitled (family of seventeen posed for portrait in living room in front of painting, between curtains)

Date

1962

People

Artist: Curtis Studio, American active 1891 - 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.13021

Human Generated Data

Title

Untitled (family of seventeen posed for portrait in living room in front of painting, between curtains)

People

Artist: Curtis Studio, American active 1891 - 1935

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 99.9
Human 99.9
Person 99
Person 99
Person 98.8
Person 98.8
Person 98.5
Person 98.3
Person 98.3
Person 98.1
Person 97.9
Person 96.9
Person 96.5
Clothing 96.5
Apparel 96.5
Person 96
Interior Design 95.8
Indoors 95.8
Person 95.5
Person 85.9
Crowd 82.5
People 80.6
Room 71.9
Audience 70.6
Shorts 70.5
Art 70.4
Face 70.2
Advertisement 69.6
Person 67.7
Drawing 63.6
Collage 63.5
Photo 61.8
Photography 61.8
Overcoat 60.8
Suit 60.8
Coat 60.8
Furniture 57.6
Female 57.2
School 57
Classroom 57
Poster 56.4
Skin 55.2
Text 55.1
Person 51.9

Imagga
created on 2022-02-05

television 56.1
telecommunication system 34.3
blackboard 29.3
people 28.4
person 26.7
man 26.2
male 24.8
businessman 17.6
men 17.2
classroom 17.1
silhouette 16.5
adult 16.5
business 16.4
room 14.8
group 14.5
office 14.4
teacher 13.9
happy 13.8
professional 13.4
education 13
equipment 12.8
computer 12.2
boy 12.2
school 11.9
board 11.7
black 11.4
couple 11.3
broadcasting 11.3
team 10.7
laptop 10.6
desk 10.4
student 10.3
brass 10.2
dance 10.1
monitor 9.9
modern 9.8
together 9.6
child 9.5
women 9.5
smiling 9.4
lifestyle 9.4
grunge 9.4
youth 9.4
smile 9.3
dancer 9.3
indoor 9.1
fun 9
sport 8.8
class 8.7
studying 8.6
corporate 8.6
wind instrument 8.5
learn 8.5
learning 8.4
finance 8.4
telecommunication 8.4
communication 8.4
executive 8.3
player 8
home 8
job 8
love 7.9
teaching 7.8
portrait 7.8
disco 7.7
dancing 7.7
ball 7.7
expression 7.7
chair 7.6
one 7.5
study 7.4
style 7.4
teenager 7.3
success 7.2
looking 7.2
worker 7.1

Google
created on 2022-02-05

Font 80.4
Ball 79.2
Art 79
Picture frame 77.1
Crew 69.9
Event 69.9
Room 68.2
Visual arts 67.7
Monochrome photography 67.6
Monochrome 67.6
T-shirt 67.3
Team 65.9
Suit 65.3
Football 64.4
Stock photography 61.8
Vintage clothing 60.7
Team sport 56.5
Illustration 55.5
Player 54.7
Photo caption 54.6

Microsoft
created on 2022-02-05

person 98.9
text 97.8
clothing 95.6
posing 93.4
man 90.8
group 83.5
old 67.2
people 61.3
display 37.4
image 34.1

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 92.2%
Calm 75.7%
Sad 19.5%
Happy 2.3%
Confused 0.9%
Angry 0.5%
Disgusted 0.4%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 33-41
Gender Male, 64.1%
Happy 92%
Sad 3.3%
Calm 2.1%
Surprised 1.4%
Confused 0.4%
Disgusted 0.3%
Fear 0.3%
Angry 0.2%

AWS Rekognition

Age 50-58
Gender Male, 99.8%
Happy 97.8%
Sad 1%
Surprised 0.4%
Calm 0.3%
Disgusted 0.2%
Fear 0.2%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 29-39
Gender Male, 97.3%
Happy 92%
Calm 2.4%
Disgusted 1.9%
Surprised 1.8%
Sad 0.8%
Confused 0.6%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 29-39
Gender Male, 98.8%
Sad 81.8%
Happy 8.8%
Confused 3.9%
Calm 1.6%
Disgusted 1.6%
Fear 1.1%
Angry 0.7%
Surprised 0.4%

AWS Rekognition

Age 25-35
Gender Male, 97%
Happy 84.9%
Surprised 5%
Fear 3.6%
Calm 3.6%
Angry 1.3%
Sad 0.7%
Disgusted 0.6%
Confused 0.3%

AWS Rekognition

Age 29-39
Gender Male, 53.1%
Calm 66.5%
Sad 20.6%
Surprised 4.4%
Confused 2.6%
Angry 1.9%
Happy 1.8%
Disgusted 1.2%
Fear 0.9%

AWS Rekognition

Age 30-40
Gender Male, 99.8%
Happy 72.3%
Sad 19.5%
Calm 2.4%
Surprised 1.9%
Disgusted 1.4%
Angry 1.1%
Confused 0.7%
Fear 0.7%

AWS Rekognition

Age 23-33
Gender Male, 82.6%
Calm 99.3%
Surprised 0.5%
Sad 0.1%
Confused 0%
Happy 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 33-41
Gender Male, 97.7%
Calm 65.2%
Surprised 12.3%
Sad 10.2%
Angry 5%
Disgusted 3.6%
Confused 1.6%
Happy 1.1%
Fear 1%

AWS Rekognition

Age 47-53
Gender Male, 100%
Calm 89.3%
Happy 6.6%
Surprised 0.9%
Confused 0.8%
Sad 0.8%
Disgusted 0.8%
Angry 0.6%
Fear 0.2%

AWS Rekognition

Age 38-46
Gender Male, 93.6%
Sad 64.8%
Calm 26.2%
Surprised 2.7%
Happy 1.9%
Disgusted 1.7%
Angry 1.2%
Confused 0.9%
Fear 0.5%

AWS Rekognition

Age 35-43
Gender Male, 96.9%
Calm 98.2%
Happy 0.5%
Surprised 0.4%
Disgusted 0.4%
Confused 0.1%
Angry 0.1%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Sad 74%
Calm 18.8%
Surprised 4.9%
Angry 0.8%
Disgusted 0.6%
Fear 0.5%
Confused 0.2%
Happy 0.2%

AWS Rekognition

Age 31-41
Gender Male, 97.7%
Calm 96.5%
Surprised 1.8%
Sad 0.5%
Disgusted 0.4%
Angry 0.3%
Confused 0.3%
Happy 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Poster 56.4%

Captions

Microsoft

a group of people posing for a photo 95.9%
a group of people posing for a photo in front of a television 92.3%
a group of people posing for the camera 92.2%

Text analysis

Amazon

2E