Human Generated Data

Title

Untitled (group of men and women seated on porch)
Date

20th century
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 4.2002.22210

Human Generated Data

Title

Untitled (group of men and women seated on porch)

People

Artist: Unidentified Artist,

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 4.2002.22210

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Person 99.6
Human 99.6
Person 99.5
Person 99.3
Person 98.1
Classroom 98
School 98
Room 98
Indoors 98
Person 97.9
Interior Design 96
Shoe 95.7
Clothing 95.7
Footwear 95.7
Apparel 95.7
Person 92.8
Person 90.3
Person 90
Person 89.9
Person 88.6
Person 88.3
Person 80.4
Person 67.5
Urban 63.8
Crowd 58.7
People 58.3
Chair 56.5
Furniture 56.5
Person 49.4
Person 46.1

Clarifai
created on 2023-10-22

people 99.9
group 99.5
adult 97.5
group together 97.5
many 97.4
woman 96.5
child 96.5
man 96.2
administration 95
music 94.4
education 92.9
musician 92.5
boy 92.2
leader 91.5
actor 90.8
singer 89.9
wear 89.6
several 87.6
dancer 87.2
theater 86.4

Imagga
created on 2022-03-11

classroom 82.8
room 71
business 37
man 36.3
businessman 36.2
office 34.9
meeting 34.8
group 33.8
people 32.3
businesswoman 30.9
corporate 28.3
person 27.7
male 27.6
team 26
executive 25.1
teamwork 25
table 24.6
professional 24.2
work 22.7
happy 22.5
communication 21.8
men 20.6
adult 20.5
job 20.3
businesspeople 19.9
laptop 19.7
women 19
sitting 18.9
computer 18.6
working 18.5
indoors 18.4
together 18.4
indoor 17.3
desk 16.6
teacher 16.2
smiling 15.9
colleagues 15.5
modern 15.4
suit 15.3
interior 15
couple 14.8
conference 14.7
manager 14
chair 13.9
worker 13.8
lifestyle 13.7
education 13
confident 12.7
happiness 12.5
center 12
building 11.8
horizontal 11.7
talking 11.4
smile 11.4
career 11.4
friends 11.3
looking 11.2
two 11
hall 10.8
handsome 10.7
student 10.6
corporation 10.6
success 10.5
casual 10.2
board 9.9
collaboration 9.8
coworkers 9.8
cheerful 9.7
discussion 9.7
portrait 9.7
technology 9.6
workplace 9.5
employee 9.3
presentation 9.3
restaurant 9.3
successful 9.1
cooperation 8.7
30s 8.6
boss 8.6
contemporary 8.5
finance 8.4
window 8.4
mature 8.4
training 8.3
positive 8.3
businessmen 7.8
partners 7.8
staff 7.6
plan 7.6
learning 7.5
showing 7.5
leisure 7.5
company 7.4
occupation 7.3

Google
created on 2022-03-11

White 92.2
Black 89.6
Black-and-white 86.2
Dress 84.5
Style 84.1
People 78.8
Monochrome 76.3
Monochrome photography 76.2
Toddler 75.1
Event 72.3
Room 69.3
Vintage clothing 69.2
Chair 67.4
Suit 64.6
Stock photography 63.8
Fun 63.6
Team 62.9
Sitting 61.4
Child 58
Crew 53.1

Microsoft
created on 2022-03-11

clothing 93.2
person 90.3
text 89.2
man 76.3
group 75
posing 53.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 99.8%
Calm 92.9%
Happy 2.6%
Sad 2.1%
Surprised 0.7%
Angry 0.6%
Confused 0.6%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 41-49
Gender Male, 52.6%
Calm 95.8%
Sad 1.4%
Surprised 1.1%
Confused 0.6%
Happy 0.4%
Angry 0.4%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Male, 94.7%
Calm 98.1%
Confused 1.4%
Surprised 0.3%
Sad 0.1%
Disgusted 0.1%
Happy 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 41-49
Gender Male, 98.7%
Surprised 53.3%
Calm 20.8%
Happy 13.4%
Sad 6.4%
Confused 2%
Angry 2%
Disgusted 1.2%
Fear 0.8%

AWS Rekognition

Age 38-46
Gender Male, 93.2%
Calm 67%
Sad 32.2%
Fear 0.2%
Happy 0.2%
Angry 0.1%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Happy 35.9%
Sad 21.6%
Disgusted 12%
Calm 11.4%
Confused 8.2%
Fear 4.1%
Surprised 3.8%
Angry 3%

AWS Rekognition

Age 36-44
Gender Female, 97.7%
Calm 38.8%
Happy 34.7%
Sad 10.6%
Fear 7.7%
Confused 2.9%
Surprised 2.9%
Disgusted 1.4%
Angry 1%

AWS Rekognition

Age 21-29
Gender Female, 91.6%
Fear 96.7%
Happy 1.2%
Confused 0.7%
Surprised 0.6%
Calm 0.4%
Sad 0.2%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 25-35
Gender Male, 89.8%
Calm 84.3%
Happy 5.2%
Fear 2.9%
Sad 2.8%
Disgusted 1.5%
Confused 1.3%
Surprised 1.3%
Angry 0.7%

AWS Rekognition

Age 51-59
Gender Male, 52.4%
Calm 61.6%
Sad 18.7%
Fear 8.1%
Confused 3.8%
Angry 3.4%
Disgusted 3.3%
Happy 0.6%
Surprised 0.6%

AWS Rekognition

Age 51-59
Gender Male, 56.1%
Calm 92%
Happy 7.7%
Disgusted 0.1%
Surprised 0.1%
Confused 0.1%
Fear 0%
Sad 0%
Angry 0%

AWS Rekognition

Age 27-37
Gender Male, 96.9%
Calm 91.4%
Happy 4%
Sad 2.3%
Confused 1.6%
Angry 0.3%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Female, 96.3%
Sad 74.9%
Calm 11.6%
Confused 4.9%
Happy 3.5%
Disgusted 1.5%
Angry 1.4%
Fear 1.4%
Surprised 0.8%

AWS Rekognition

Age 23-33
Gender Female, 99.7%
Calm 95.5%
Sad 2.8%
Happy 0.6%
Confused 0.3%
Surprised 0.3%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Female, 95.1%
Calm 52.9%
Sad 30%
Confused 4.9%
Fear 4.8%
Angry 2.5%
Disgusted 1.8%
Happy 1.7%
Surprised 1.3%

AWS Rekognition

Age 50-58
Gender Male, 99.9%
Calm 65.2%
Disgusted 20.8%
Angry 5%
Sad 4%
Confused 2.3%
Fear 1.6%
Happy 0.6%
Surprised 0.6%

AWS Rekognition

Age 48-56
Gender Female, 98.4%
Calm 67.6%
Happy 26%
Sad 2.9%
Fear 1.1%
Angry 0.8%
Surprised 0.7%
Confused 0.5%
Disgusted 0.5%

AWS Rekognition

Age 48-56
Gender Male, 99.5%
Calm 67.9%
Sad 20.4%
Confused 3.1%
Angry 2.6%
Disgusted 2.4%
Surprised 1.5%
Fear 1.1%
Happy 1%

AWS Rekognition

Age 43-51
Gender Female, 97.9%
Calm 92%
Happy 4.2%
Sad 1.5%
Fear 0.6%
Surprised 0.6%
Confused 0.5%
Disgusted 0.3%
Angry 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 99.6%
Person 99.5%
Person 99.3%
Person 98.1%
Person 97.9%
Person 92.8%
Person 90.3%
Person 90%
Person 89.9%
Person 88.6%
Person 88.3%
Person 80.4%
Person 67.5%
Person 49.4%
Person 46.1%
Shoe 95.7%

Categories

Imagga

events parties 95.7%
people portraits 2.2%
interior objects 1.3%

Text analysis

Amazon

PRE
THE PRE
THE
OTT

Google

THE PREOTT
THE
PREOTT