Human Generated Data

Title

Untitled (group portrait of women in front of tapestry)
Date

1950
People

Artist: Peter James Studio, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20089

Human Generated Data

Title

Untitled (group portrait of women in front of tapestry)

People

Artist: Peter James Studio, American

Date

1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20089

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.3
Human 99.3
Person 98.9
Furniture 98.6
Person 98.6
Person 98.5
Person 98.4
Person 98.3
Person 98.1
Interior Design 94.7
Indoors 94.7
Person 92.8
Person 90.3
Clothing 89.8
Apparel 89.8
Person 86.4
Room 81.4
Crowd 80.6
Person 78.9
People 75.2
Dining Table 69.8
Table 69.8
Audience 67.7
Female 64.9
Photography 61.7
Photo 61.7
Suit 58
Coat 58
Overcoat 58
Chair 56.1
Clinic 55.2

Clarifai
created on 2023-10-22

people 99.9
group 99
adult 98.6
man 98.3
woman 98.3
monochrome 97.1
indoors 93.8
education 91.6
group together 91.3
wedding 91.2
child 89.5
chair 88.4
many 87.9
furniture 87.3
leader 86.4
music 84.1
teacher 83.6
actor 81.1
musician 79.7
room 76.3

Imagga
created on 2022-03-05

person 41.5
businessman 39.7
man 39.7
male 37
people 35.7
business 32.8
adult 30.3
professional 27.2
office 25.7
meeting 25.4
men 24.9
businesspeople 24.7
group 24.2
businesswoman 23.6
room 23.6
team 22.4
corporate 22.3
worker 21.8
happy 21.3
women 19
teamwork 18.5
table 18.3
smiling 18.1
talking 18.1
colleagues 17.5
work 17.3
home 16.7
indoors 16.7
desk 16.2
sitting 15.5
cheerful 15.4
job 15
couple 14.8
successful 14.6
smile 14.2
executive 14.2
teacher 14.1
together 14
wind instrument 13.5
handsome 13.4
brass 13.3
musical instrument 13.1
confident 12.7
working 12.4
lifestyle 12.3
education 12.1
modern 11.9
indoor 11.9
communication 11.8
conference 11.7
portrait 11.6
cooperation 11.6
adults 11.4
classroom 11.3
manager 11.2
suit 11
happiness 11
kin 10.7
discussion 10.7
family 10.7
partner 10.6
30s 10.6
success 10.5
mature 10.2
laptop 10.2
casual 10.2
20s 10.1
collaboration 9.8
associates 9.8
discussing 9.8
world 9.8
40s 9.7
new 9.7
tie 9.5
career 9.5
employee 9.4
nurse 9.1
color 8.9
computer 8.9
interior 8.8
student 8.8
casual clothing 8.8
cornet 8.6
two 8.5
friends 8.5
life 8.4
house 8.4
holding 8.3
patient 8.2
board 8.1
looking 8
blackboard 7.7
class 7.7
human 7.5
clothing 7.5
presentation 7.4
document 7.4
coffee 7.4
mother 7.4
black 7.2
hall 7.1
day 7.1
medical 7.1

Google
created on 2022-03-05

Black-and-white 85.3
Style 83.9
Font 82.6
Art 78.3
Tree 74.1
Monochrome photography 71.9
Monochrome 71.3
Event 70.6
Room 68.3
Visual arts 64.8
Stock photography 62.6
Eyewear 59.5
T-shirt 58
Fun 57.9
Team 56.9
Sitting 56.5
Photographic paper 56.3
Vintage clothing 56.1
Illustration 55
Painting 53.9

Microsoft
created on 2022-03-05

text 95.7
person 87.3
clothing 86.9
dance 69.9
woman 65.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 95.1%
Sad 82.7%
Calm 15%
Surprised 0.5%
Disgusted 0.5%
Angry 0.4%
Happy 0.4%
Fear 0.4%
Confused 0.2%

AWS Rekognition

Age 45-51
Gender Male, 98.8%
Calm 97.6%
Sad 0.9%
Happy 0.8%
Confused 0.3%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 49-57
Gender Female, 59.6%
Happy 84.2%
Calm 8.2%
Confused 3.3%
Sad 2%
Surprised 0.9%
Disgusted 0.6%
Fear 0.5%
Angry 0.3%

AWS Rekognition

Age 49-57
Gender Male, 100%
Calm 99.4%
Surprised 0.2%
Happy 0.2%
Confused 0.1%
Sad 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 45-53
Gender Male, 99.1%
Calm 99.9%
Happy 0.1%
Sad 0%
Disgusted 0%
Confused 0%
Angry 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 48-54
Gender Male, 93.2%
Calm 85.3%
Sad 10.4%
Happy 3.5%
Disgusted 0.2%
Confused 0.2%
Angry 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 39-47
Gender Male, 99.3%
Sad 42.6%
Calm 33.9%
Confused 15.7%
Happy 2.4%
Disgusted 1.7%
Angry 1.5%
Fear 1.3%
Surprised 0.9%

AWS Rekognition

Age 45-53
Gender Male, 95.7%
Calm 83.8%
Sad 11%
Surprised 1.4%
Happy 1.3%
Fear 0.7%
Disgusted 0.7%
Confused 0.5%
Angry 0.5%

AWS Rekognition

Age 47-53
Gender Male, 51.4%
Calm 59.4%
Fear 13.7%
Disgusted 8.1%
Sad 6.2%
Angry 4.3%
Surprised 3.6%
Confused 3.3%
Happy 1.4%

AWS Rekognition

Age 26-36
Gender Male, 74.7%
Disgusted 81.4%
Calm 13.3%
Surprised 3.6%
Sad 0.7%
Angry 0.4%
Happy 0.2%
Confused 0.2%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Chair
Person 99.3%
Person 98.9%
Person 98.6%
Person 98.5%
Person 98.4%
Person 98.3%
Person 98.1%
Person 92.8%
Person 90.3%
Person 86.4%
Person 78.9%
Chair 56.1%

Text analysis

Amazon

8