Human Generated Data

Title

Untitled (large banquet)

Date

1948

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20097

Human Generated Data

Title

Untitled (large banquet)

People

Artist: Peter James Studio, American

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 93.7
Person 90.3
Furniture 82.1
Face 81.7
Interior Design 78
Indoors 78
People 77.6
Couch 74.6
Person 71.4
Person 70.9
Female 68.1
Clothing 65.5
Dress 65.5
Apparel 65.5
Crowd 65
Person 63.4
Portrait 61.4
Photography 61.4
Photo 61.4
Person 61.1
Leisure Activities 59.4
Person 57.7
Screen 56.5
Electronics 56.5
Baby 56.3
Kid 55.5
Child 55.5
Girl 55.4
Advertisement 55.2
Poster 55.2
Collage 55.2
Monitor 55.1
Display 55.1
Person 51.2
Person 49.7
Person 42.1

Imagga
created on 2022-03-05

freight car 100
car 79.6
wheeled vehicle 62.7
vehicle 40.5
conveyance 20.9
travel 16.2
building 15.4
old 15.3
architecture 14.8
city 14.1
wall 14
art 12.5
tourism 12.4
sky 12.1
night 11.5
water 11.3
grunge 11.1
black 10.9
case 10.7
urban 10.5
landscape 10.4
sea 10.2
stone 10.1
texture 9.7
structure 9.6
crowd 9.6
decoration 9.5
scene 9.5
ancient 9.5
people 9.5
silhouette 9.1
history 8.9
shop 8.8
shoe shop 8.7
party 8.6
house 8.3
dark 8.3
historic 8.2
pattern 8.2
paper 8
culture 7.7
rusty 7.6
grungy 7.6
famous 7.4
retro 7.4
light 7.3
design 7.3
business 7.3
group 7.2
landmark 7.2
religion 7.2
sculpture 7.1

Google
created on 2022-03-05

Rectangle 88.1
Font 80.2
Art 78.9
Window 73.2
Monochrome 68.9
Pattern 68.6
Visual arts 67.2
Facade 66.6
Room 65.8
Monochrome photography 64.9
History 64.8
Paper product 62.6
Building 55.5
Urban design 52.1
Illustration 52
Brick 51.7
Collection 50.8

Microsoft
created on 2022-03-05

text 98.9

Face analysis

Amazon

AWS Rekognition

Age 22-30
Gender Female, 89.7%
Calm 84.8%
Sad 8.9%
Happy 2.1%
Confused 1.3%
Surprised 1%
Disgusted 0.8%
Fear 0.7%
Angry 0.4%

AWS Rekognition

Age 21-29
Gender Female, 83.5%
Sad 89.7%
Calm 4.6%
Confused 1.5%
Happy 1.5%
Fear 1.4%
Angry 0.7%
Disgusted 0.5%
Surprised 0.2%

AWS Rekognition

Age 7-17
Gender Male, 54.6%
Calm 94.2%
Sad 4.1%
Fear 1%
Happy 0.1%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 27-37
Gender Female, 53.2%
Happy 64.9%
Calm 27.7%
Sad 4.5%
Fear 0.9%
Angry 0.6%
Confused 0.5%
Disgusted 0.5%
Surprised 0.4%

AWS Rekognition

Age 18-26
Gender Male, 62.9%
Calm 98.8%
Sad 0.7%
Fear 0.2%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0%

AWS Rekognition

Age 18-26
Gender Male, 74%
Calm 46.2%
Angry 19%
Fear 11.9%
Happy 10.9%
Sad 6.3%
Surprised 2.5%
Disgusted 1.6%
Confused 1.6%

AWS Rekognition

Age 18-26
Gender Female, 58.4%
Sad 58.5%
Calm 35.8%
Fear 1.5%
Happy 1.1%
Confused 1%
Angry 1%
Disgusted 0.7%
Surprised 0.5%

AWS Rekognition

Age 6-14
Gender Male, 74.2%
Sad 42.8%
Calm 40%
Happy 6.5%
Confused 6%
Fear 1.9%
Disgusted 1.2%
Surprised 0.8%
Angry 0.7%

AWS Rekognition

Age 20-28
Gender Male, 98.2%
Calm 66.3%
Sad 20.8%
Confused 9.1%
Angry 1.7%
Happy 0.8%
Surprised 0.6%
Disgusted 0.4%
Fear 0.4%

AWS Rekognition

Age 16-22
Gender Female, 85.4%
Sad 89%
Angry 4%
Calm 3.8%
Fear 1.1%
Happy 1.1%
Confused 0.6%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 18-24
Gender Female, 52.4%
Sad 78.5%
Calm 14.4%
Fear 2%
Confused 2%
Happy 1%
Disgusted 0.8%
Angry 0.8%
Surprised 0.4%

Feature analysis

Amazon

Person 90.3%

Captions

Microsoft

a group of people standing in front of a crowd 58.7%
a group of people standing in front of a building 58.6%
a crowd of people standing in front of a building 58.5%

Text analysis

Amazon

5